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ABSTRACT 

Using the Delphi technique, the staff of Project 
FOLLOW^P-jsurveyed community college educators in Texas to determine 
desirable characteristics and uniformity of terminology and 
definitions for a pro|*osed_statevide student follow-up management 
information system for Texas community colleges. Of 234 individuals 
invited to become Delphi panel members, 193 (82 percent) accepted and, 
participated 100 percent in the three survey rounds. The panelists 
represented 47 of the 48 public community colleges in Texas, various 
state agencies, the Project FOLLOW-UP Committee, and the Advisory 
Council for Technical- Vocational Education in Texas. The open-ended , 
round I > questionnaire produced 61 statements which were presented as 
round II on a Delphi format requiring the panelists to respond to 
each ' statement on a 1-7 (agree-disagree) rating scale. The third 
round (formated in the same manner) consisted of 64 statements, and 
statistical data' of round II responses. Panelists^ reconsidered their 
round II responses in *the light of group opinion and gave narrative 
explanations ,for responses remaining outside the interquartile range,. 
Data are organized according to 15 areas of professional employment 
identified among the panelists. Copies of the three survey 
instruments and tabulated responses are appended. (UHM) 
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The SCOS -DELPHI study is the result of Project FOLLOW-UP 1 s 
efforts to obtain a consensus of opinion and appropriate input: 
regarding the characteristics of a community/junior college 
student follow-up system. Soon after the May 15, 1974, commence- 
ment date of Project FOLLOW-UP, it" became evident that certain 
philosophical statements and decisions should be documented in 
order for the system development and design ptu*se to be com- 
pleted** The Delphi research technique was chosen as the 
"documentation tool 11 because many of its goals coincided with 
many of our own, i.e., receiving maximum input and involve- 9 
ment, feedback of results to the panel, obtaining visibility 
by round iteration, "reconsideration 11 of responses, etc* 

The formation of Project FOLLOW-UP is actually the result of a 
legislative mandate stating that funds "shall be expended for 
the purpose of developing data directly relating to programs 
conducted by public junior colleges and shall be for the purpose 
of developing systems for use by the junior colleges. 11 Tarrant 
County Junior College was selected as the primary contractor 
for the development of the follow-up system by the Texas Educa- 
tibn Agency and an advisory committee of community /junior 
college educators in the Fall of 1974. Project FOLLOW-UP is 
fullyifunded by the Division of Occupational Research and De- 
veLopment, Department of Occupational and Technical Education, 
Texas Education Agency. Six definable phases have been identi- 
fied for completion prior to the August 31, 1976, Project 
termination date: 

Developmental Phase 

Design Phase 

Sub-System Test Phase 

System Integration Phase 

Evaluation and Report Phase 

Recommendations and Future Funding Phase 

If we can answer any questions about the SCOS-DELPHI study or 
provide more information about Project FOLLOW-UP, please let 
us know. Thank you. 

Dr. Jim F. Reed 
Project Director 
Project FOLLOW-UI' 
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METHODOLOGY 

Delphi Technique 

A brief overview of the Delphi Technique 
as a research tool seems appropriate before 
presenting the utilization of this method 
through SCOS -DELPHI. 

The Delphi Technique is a procedure origin- 
ally developed by the Rand Corporation for 
obtaining greater consensus among experts 
about urgent defense problems without face 
to face discussion. It is a method of elic- 
iting and refining group judgment, During 
the 1950 f s, the technique was put to use by 
the Defense Department in policy analysis 
and technological forecasting. The 1960's 
brought a great upsurge in its use among 
corporations in long range planning, and it 
was during this period that the Delphi 
method was newly discovered and put to its 
broadest use. Today the Delphi Technique 
is being used in many educational settings 
and statewide planning procedures. 

The objective of the Delphi Technique is to obtain a consensus 
without bringing individuals together in a face to face meeting; 
this is achieved by having the panel of experts complete a serie 
of questionnaires interspersed with controlled feedback. Not 
only can this mode of controlled interaction among the respond- 
ents mean a savings in time and money, but it also permits inde- 
pendent thought jon the part of the participants and is helpful 
to them in the gradual formation of a considered opinion. 

Other features of the technique are that panelists are not re- 
quired to travel, not required to do any advanced reading, and 
not required to do any research prior to responding. The tech- 
nique has three hallmark features: (1) all responses are ob- 
tained independently of one another by questionnaire; (2) 
interaction among panelists is accomplished in' a systematic 
way, incorporating controllecSf^edback; and (3) the procedure 
tends to minimize the biasing eMet^^fdominant individuals, 
the effects of irrelevant comments , ancPthe pressure towards 
group conformity. 

n S 

% 

x 





Panel Selecti 



In keeping wit v - the Delphi Technique, the 
SCOS* DELPHI Panel was comprised of experts 
in the field of community and junior college 
education* 

These experts wore initial ly*drawn from th 
three following gtcups --Project FOLLOW-UP 
Advisory Committee, College Liaison Repre- 
sentatives, and the Advisory Council for 
Technical/oca tional Education in Texas, 
addition *~ Project FOLLOW-UP Advisory Com- 
mittee n:enbers and Co.llege Liaison Repres 
tatives we're Invited to nominate other 
individuals -having interest and expertis 
in student coMow-up._ 



The Project FOLLOW-UP Advisory Con\mitte 
consists of 17 members throughout the state 
and serves in an advisory capacity concerning 
Project affairs. Sixteen members chose /to 
participate as Delphi panelists. This com- 
mitee was asked to serve. as a jury for fcval 
nation of the Round I instrument. 
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Shortly after Project FOLLOW UP becam 
the' President of each of the 48 pubL£_ 
colleges in Texas was contacted ^^Ta/sked 
person to represent their institution ir 
was asked. that this individual be am 
of that college's presently operati 
reporting procedures , and the typa 
on Texas community college student 
sentatives throughout the sta£<=^ 
ists« 



era 




al in May, 3, 
tt^and jiinior 
appoint a' liaison 
yoject niatt£rs\ It 
Iri possessing /*<nowledp,e 
/low-up system, State 
3ta presently collected 
f the 48 Liaison Repre 
ygrved a< SCOS QELEHj p anel 



/ 



Of the 17 -member Advisory 
Education in Texa 



Otx^ hundred 
CoTTmittee an 
SCOS -DELPHI 
to serve on 




mcil for Technical * Vocati onal 
fry ed on the Oe \pWi ' pan el. ~ 



individuals 
College Liaison 

Of this num 




lominated by the Advisory 
^entatives to serve as 
3,6 individuals agreed 
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The 234 individuals who weire invited, to become panelists were 
mailed a. commi tment £orm and the Delphi Round 1 instrument. 
(43£e Appendix A, p. 17). Of this number 193 returned the com- ^ 
mi tment form and th^completed Round 1 instrument , agreeing-^ 
to participate in the remainder bf the study. Tbesje^ 193 
panelists responded with 1007» participation on the Round 11 
and Round 111 Delphi instruments. 

- — , _ . • 

Fifteen different areas of employment were represented by the 
panelists. These areas, along with the number of panel members 
in each area. and the percentage of the total panel, is included 
in Appendix' B, p. 42, as Table 2. 

The panelists represented 47 of the 48 pubLic community /junior 
^colleges in Texas, as well as members of state agencies,' Project 
FOLLOW-UP Advisory Committee, and the Advisory Council for 
Technical-Vocational Education in Texas. This panel representa- 
tion analysis is presented on, page/ 40 as Table 1 in; Appendix B. 

Development of Instruments 

The Delphi Technique, as already stated, requires the tfse of 
mail questionnaires. The present study consisted of three 
rounds, thus necessitating three questionnaires. (Appendix A, 
p. 16, contains -the Panel Commitment Form, and the Round i; 11, 
and III instruments.) The initial questionnaire was crucial 
because it was priigarily open-ended and designed to gather a 
broad range of opinions. The following factors were taken into 
consideration when formulating the Round ! (questionnaire. The 
first factor considered was question format. The Round I 
questionnaire* used predominantly open-ended questions which was' 
in keeping with the methodology used in other educational studies 
that have utilized the Delphi technique. The second factor was 
how : to determine the actual content of the questions. Jt was 
decided that; a Variety of sources would be utilized with the . 
major sources being a review~of the relevant follow-up litera- 
ture, consultation with recognized Delphi research experts 
. (consultants), suggestions from the Project Advisory Committee 
members, information gained by the personal interviews .with ^ 
community college representatives and input by the Project 
FOLLOW-UP staff . - - , ) 

TheJ.n^fc±&l questionnaire went through seven revisions prior to ^ 
being sent to the Project FOLLOW-UP Advisory Committee. The 
committee was to review the questionnaire arid recommend addi- 
tional changes, if necessary. This process constituted the 

i * . . * 
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establishment of face validity. After the eighth revision, the 
questionnaire was then sent to all <£he panelists. - 

Data Collection 

The Round I questionnaire was sent to 234 
persons. Eighty- two percent (193 indivi- 
duals) returned the commitment statement 
as well as the initial questionnaire. 
The Round I responses were reviewed by a 
panel of six persons. Each reviewer 
worked individually and condensed and 
categorized the responses into what he 
or khe considered to be a major area of 
conaern. After each reviewer had com- 
pleted this process, three persons com- 
piled and formated the predominant 
statements. 

These statements in turn comprised the 
Round II instrument. The process just 
described was utilized in order to estab- 
lish internal validity. The format of the 
Round II instrument, consisting of 61 
statements, was designed for response on 
a ranking scale of one to seven. The 
panelists were instructed to indicate 
their degree of agreement or disagreement 
with each statement. The Round II in- 
strument wassailed to' 193 panelists and/ 
a 100% return was achieved. * 

The Round II results were analyzed via th 
use of a computer program which computed 
the mean, ijogdian, standard deviation and 
interqttart^e range for each question, 
median and interquartile ran^e for the tot 
sample was then formated On the Round IT" 
instrument, along with the addition of 
three new statements for which panelists 
requested consensus. 
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The 193 panelists once' again responded with 
a 1007o completion of the Round III form, ' \ 
On the Round III instrument the panel members 
were instructed to reevaluate their Round II 
response in light of 'the group consensus, 
and provide a narrative explanation if their 
Round III response remained outside the inter- 
quartile range* A report^of thesis narrative 
responses has been compiled and is included 
as Appendix D on page 83. 



Analysis of Data 

The final' processing consisted of an item analysis ofi; the data 
in which the mean, median, standard deviation and interquartile 
range was computed in addition to a frequency distribution pf 
responses (Appendix C, p. 69). A comparison, of the interquartile 
range for each question on Round II and Round III has been 
graphically charted in order to present the degree of convergence 
which occurred. (Included in Appendix B, p. 59, as Table 4.) . 
In addition, the data has been analyzed by the different employ- 
ment areas represented by the panelists. This analysis is pre- 
sented in terms of median and interquartile range in Appendix B, 
Table 3, page 43. 

Project FOLLOW-UP's SCOS-DpLPHI Utilized the Delphi vesp&vcK 
method to derive consensus , among a group of Texas public' 
community/junior college personnel and other selected panelists ' 
yho, by virtue of their background, qualify as "experts. 11 
The sought after consensus was in the area of characteristics, 
definitions, and terminology. The final results of this study 
have helped to identify the desirable characteristics, provide 
for uniformity of terms and definitions, and generally provide 
a solid, opinion base for incorporation into the design of the 
master student follow-up management information system. 




Members of the sWs-DELWl panel were comprised of individuals 
having expertise in the area of community/ junior college educa- 
tion. Panelists represented 47 of the 48. Texas public community 
and junior colleges , Texas state agencies, project FOLLOW-UP 
Advisory Committee, Advisory Council" for Technical-Vocational 
Education in Texas, as well as individuals outside these groups. 
(.Table 1-in Appendix B., p.40 , details the representation of 
this Delphi panel). 

Through the 'use* of appointments by* designated institutional v 
representatives and members of the Projec^FOLLOW-UP Advisory A 
Committee, 234 individuals were invited to become Delphi pane^ 
members. Of this number, ,193 (representing 32%) accepted and 
responded with the Round I questionnaire. These 193 panelists 
participated 100% in the two final rounds. ^ 

The SCQS-DELPHI Round I questionnaire (S pages ^in length) was - • 
predominantly open-ended in keeping with the Delphi method of 
gathering valuable information through these narrative responses. 
.The analysis of Rea^fra^t^^xiuced 6 1' s tat^nents which were pre- 
sented a's Round/TI on a Del/phi format requiring ttye panelists to 
respond to eayn. statement on* a 1 through 7 - Cagree-disagree) 
ranking scaled The, third and final Round (foliated in the s x ame 
manner) consisted of these same . statements , including three ad- N 
ditional ones, and statistical data from 'Round 13* in^ the forpi of 
the group medianvand interquartile range for each statement . 
.»\j?he panelists wer^ ins trujte^ to reconsider their "Round II 
response 'in ; li^i't of the grdup opinion and respond to Round III 
.accopd!k^Iy . A narrative explanation was- requested, should- a 
response remain^ outside the interquartile range. Analysis of 
the§e minority' responses Is included in -this report as Appendix 
. D, page r . 

Fifteen different -areas of employment were identified among the 
panelists' (.Table 2 of Appendix B",' page 42). Each of these fifteen 
'groups have /Dq^Kanaly zed as to median response and interquartile 
rg^ge on each^^fctie 6^ statements comprising Round III. This ^ ^ 
data is presented graphically as. Table 3 of Appendix B, on page 
43 of ^this report. TSfe v response of the panelists c in each of the\ 
fifteen 'employment a^eas can be compared with 1 the tctal panel' 
'-response on each of the 64 statements contained in Round III. 
This ana Lysis graphically presents the degree of consensus within 
each employment area, as well as the degree of consensus among 
the- 15 different areas represented. — K 
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The total panel response to each of the 64 Round III statements 
has been computed in terms of mean, median, standard deviation, 
and interquartile range. In addition, a frequency distribution 
illustrating the number of responses for each 1 through i ranking- 
choice on each statement, has been compiled. This data is included 
in this report as Appendix C, page 69. 

]^ keeping with the research findings concerning the Delphi Tech- 
nique, convergence between Round II and Round III did occur, 
witfrqut exception, on each of the 61 SCOS-DELPHI statements re- 
iterate^ on Round III. The narrqwing of the, interquartile range 
between N Round II and Round III, illustrating! this convergence, 
is presented graphically as Table 4 in Appendix B on page 59 of 
this repeat. \ , x 



Trends Established through SCOS-DELPHI 



Analysis of data received through SCOS-DELPHI has revealed* spec- . 
ific trends whicH ha^ been established through this stiicty. The 
following statements which appeared on the Delphi instrument re- 
flect these trends. Th^ N statements have been arranged by category 
with the number preceding^ ,each statement being the number on the 
Round 11^ and/or Round III instruments, and the number following x 
each statement (Median Respot\se) reflecting the degree of agree- 
ment (on a 1 to 7, agree-disa£ree , ranking scsFle) with that particu 
lar statement on the part of th^fe total panel. ^ 



Statement \^ v \ Median ' 

Number - Category , - Response 

Educational Intent: 

19/ The documentation of a student 1 s initial 1.9- 

educational goal should be maintained and 
updated at the beginning of each enroll- 
ment period. 

21. Information, pertaining to the student's 2.2 

\ * educational goal should be obtained 

during the time of the .registration* pro- 
cess * ™ 

Identification of. a student's "educa- 2.3 
tional goal" shpuld provide the basis 
for follow -up. 



* P?ge 9 

' Median 

Category ' Response 
Course and College Withdrawal:. 

Students who withdraw from college prior l.-A 
to completion of the semester should be 
followed up regarding their reasons for 
college withdrawal. , 

An immediate' follow-up' should be initi- 1.5 
a ted on s tuden ts^wfio do not complete 
the period forwhich they enroll. . . 

■ - * 
Nonre turning Student: - - 

An immediate follbw-up should be initiated U9 
on students who complete a semester but 
do not enroll the following long enroll 
ment period. / 7 o 

Occupational -Technical Students,: 

Occupational- technical students should^be U7 
"followed up the same length of time as 
academic student^. ■ ' * 

A student should have enrolled in at 2.3 
least one course funded with occupational- 
technical funds before he or she is counted 
as an occupational-technical program en- 
rollee. 
\ ' 

Graduates : 



Program graduates .should be followed up 2.4 
at the end of the first, third f and fifth 
year. 

A randomly sampled number. of program* 3.^ 
graduates should be f ollowed-iip, for 
>a period of longer than five years. 
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Statement 
Number 



Cat< 



S»Median 
Res pons 



L6. 




31. 



27. 



49. 



46. 



Employer Contact: 

Both information received from the student 
and from his employer should be analyzed 
'in determining (bwh ether" job skill require- 
ments have been met. 

Information regarding a student's salary 
should be retrieved. 



Before a survey of employers^ £ former 

tudents is made regarding "an evaluation 
of the training an employee has received", 
the institution&hould first be^respons- 
ible for' obta-ining the permission of these, 
Xorme'r" students to make^such a contact. 



Data Collection; 



1.1 



2.4. 



One designated office ^within a local in-, 
stitutlon sTtbuld be assigned^ the respon- 
sibility of conducting^tudent. follow-up 
studies ♦ 

A^follow up system should empt iafrvze 
the collection of data which will* rfeflect 
needed institutional change's* 

The student's Opinion of whether the col 
lege fulfilled his or her educational needs 
is one of the most important types of 
follow up information to be obtained. , 
* 

A student follow up system should emphasize 
.the collection of data which will be bene- t 
ficial for statewide planning and coordi- 
nation. 



1.3 



1.6 




2.4 



f 
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Statement 
Number 



39. 



23. 



32. 



29. 



4. 



Category 

Ana lysis and Reporting : 

The State should develop a plat^ to pro- 
mulgate significant follow-up studies 
to interested institutions. 

Each individual institution should 
develop their own methods for local 
collection, analysis and reporting of 
follow-up information based on uniform 
(statewide) procedural guidelines. 

Miscellaneous: 

The "conditioning 11 of students to 
follow-up studies is important to a 
follow-up system. 

More community college funding will 
be necessary for the purpose of imple- 
menting a comprehensive follow-up system. 

Random sampling techniques would be an 
acceptable method of drawing conclusions 
from follow-up information, which would 
be applied, to the total population of the 
group of students studied. 



Median 
Response 



2.1 



2;2 



S 

1.3 



1.4 




Glossary of Terms 

V • » 

In -addition to the trends outlined above , uniformity of 
certain relevant terms has been, established^ It is believed 
that this uniform terminology is nec^sary for the proper 
functioning of a student f o 1 low -tjp<sys tern. Some of the fol- 
lowing definitions were deriv^cKfrom results of the Delphi 
study. 
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completer: A student whose/educational objective is cop- 
pleted culminating in a degree, certificate, or selected 
urse(s)., s C 




drop-out: Any student who leaves college (formal withdrawal, 
walk-off, or nonreturning stadent) wrior to achieving Kis/ 
her stated objective, with indications of no intent to 're- 
turn- -also inc lobes those students who withdraw from college 
during a regular semester and do not return for the next 
lo&k semester. , "! 

educational goal (intent): That objective which^t student 
states that he/she expects to attain during, the course; of 
his/her time spent at the respective educational institution. 

exit interview: The procedure* wfrereby institutional contact 
is made with a student, leaving the college (graduate or with- 
drawal) for the purpose of collecting relevant information. 

* # • - ' 

«- « 

follow-up orientation:.. That procedure which makes the stu- 
dent aware of follow-up activity which may be occurring at 
a^later date. - - 

graduate: A student who completes a fdrmal program documented 
in the college catalog. 

no-show: A student who completes the registration process 
but never ,! shows up 11 for class(es). ^ x 

• y 

nonreturning student: A nongraduate of the respective insti- 
tution who, having completed an enrollment period, does .not 
return for the next enrollment period of th£/£ype previously » 
completed, (i.e., consecutive long terms","" summer terms,* 
mini -s erne s ters , etc.) % 

occupational -technical program enrollee: A student who des- 
ignates an occupational- technical major and is .currently 
enrolled- or has. been etu^lled, in at least one course funded 
with occupational-technical funds. ^ ' ' 



x 
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10. stop -out: A student who temporarily terminates his formal 
educational pursuits with indications of intent to continue 
at a later date. 

student follow-up: That procedure-which collects and docu- 
\ ments status and/or opinion information from former commu- 
nity college students as well as students who do not complet 
the course(s) for which they enroll. 

12. walk-off: The student who stops attending class (es) or 

college and does not follow the formal withdrawal procedure. 



the Delphi Research Technique has been an 
appropriate method for .gaining the informa- 
tion desired by Project FOLLOW-UP through 
this study. The interest and concern in the / 
area of community /junior college student follow- 
up' in Texas has become evident through SC0S- 
DELPHI. The ideas and thoughts derived from 
the study aper" felt to be indicative^ of the 
feelings b£ld by public community /junior 
college/educators throughout the state. In 
viewer the fact that only one such college 
did^nof .gargicipate in SCOS-DELPHI, the con- 
sensus of^opiftt©Qs established through this 
study reflect a x 97>9 peiicent representation 
of. the reieyarffc population. The knowledge 
shared by^ndividuals involved in this study 
will {^utilized for the purpose of designing 
a more adequate and ~uni form method of follow- 
ing up students who attend public community 
and junior colleges in the state of Texas^r 
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/ * SCOS-DELPhT 
(System Characteristic Opinion Study) 
PARTICIPATION FORM 



£ a3ree to participate in all three Delphi! Rounds: [_ / 
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*Nattte_ t 

Title ^ 

Brief description of present duties : 



7" 



State 



2IP 



Employer 

Address / 
City^V. \ x . 

Telephone, t _ _. ^ 

Total number of years employed in education 

* * >t 
Total number of years employed in community college education^ 

Highest degree heid:__ m fin the field of: 




I am returning the ♦Jfcstl^naire , and prefer not to be a participant;/ / 



J am returning the Questionnaire, and prefer not to be a parti ci pant / 
but would appreciate receiving the results of this study: J 



*Names are for record keeping only and will not be used in published ' 
tabulations. All responses will be held .in the strictest confidence 
at all/ times — anonymity, being an essential part of the Delphi process. \ 



erIc 



23 



?£ge 18 

/ / 
/ 



SCOS - DELPHI Par tic ipat t p_n F orm, C ontinued 

I wish to nominate the following individuals ..as potential Delphi 
members. I be l ; ieve- -these individuals can proyide valuable input 
the design of a Texas community college .student follow-up system 

Signature 



P^aiie/i 
InW 



i. Name 



/ 



lit Le 



7 Fiace of" Err.p loyment 

Cit y _ btate. 

/ " / 



3. 



Address 



Name 



Titie 



0 / 



Piace of 2u.p Ip^ment^ 
Citv 



.\ame 




State 



\ Li 

/ 

Address^. 

7 ip 



* I 1' • 



Titie 



Place /of Ercployirent 
Citv 



btate 



Address 





4 . Nai..e 



Title 



Place cf Er.pioyr:ient_ 

City 

Name 



Address 



State 



LI 



;it ie 



Place cf £:wployr.>ent_ 
City 



Address 



State 



Narie 



i l r ie 



Place of Emp loyir.ent 
City 



7. Others 



ERLC 




Address 



Projact FOLLOW -IT 

TARRANT COUNTY JUNIOR COLLEGE DISTRICT 

/ 



*Name of Respondent 

Title 



Institution 



- ORIG INAL QUESTIONNAIRE " 
< ROUND I 

' SCOSjtTELPHI STUDY 

(.System Characteristic Opinion Study) 




I. Frorr. the standpoint of community college education, how would 
/ you d efine the following terms or phrases : 

. '. / ' . 
A . S tudent exit ^ ... 3 _ ~- - - - r - 



B. Drop-out_ 



Completer_ 



D. Stop-out_ 



E. Educational Goal, 



F. Drop -up 



G. Noh- completer^ 



/ • 



ERIC 



★NAMES ARE FOR RECORD KEEPING ONLY AND WILL MCT BE USED IN PUBLISHED 
TABULATIONS; ALL RESPONSES WILL BE HELD IN THE STRICTEST CONFIDENCE 
Af ALL TIMES. . 

25 
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Que s t i qiW ire , _ C c^tj. nued 



Non-re turniri<fs tudent _ _ 




I. Undecided student 



K,. Returning studergjg 



L. l&nr 




J. Occupational/Technical* Djrijjlfrarn enrcjilee_ 




0^^' terms and definitions which you feel are unique/ and to 
wbMn'' you would like the Panel's response': 



-0 



• if 
-/ 



IT. Please, provide for opi^ion^oncern injP: t he follow-up of 
students AFTER .iy^(TTHE INSTITUTI^J as". outlined" below: 

A . OCCUPATIONAL-TECHNICAL 



1. Need of f ollow-up^_./ 



Frequency and /or length of/ £iir.e. to be fol lowed -jupj 



9 

ERIC . 



3. /Types of follow-up information to be collected 



/ 



20 



Questi onnaire, Continued 
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B. UNIVERSITY! PARALLEL (Traditional bacealaureate/4ype) 



1. Need o 



f foltpw-up_ 



2. Frequency and/or length of tinfe to be ftollo^etjl-m 



3, ^ Types^>f fol low-tip xrvFo^m^tion- to be collected^ 



C. ADULT AND CONTINUING EDUCAtW STUDENTS: 
1, Need of follow-up ; 2 



- — 



2* Frequency and/or length of time to be followed-up 




3. Types, of follow-up information to- be collected r 



D. COMPENSATORY /DEVELO PMENTAL STUDENT'S (Reme-dial, Refresher, 
^^ther) : , , 

1. Need* of follow-up . 

» 



2. Frequency and/or length of time to be f ollowe'd-up ^ 



frit* 



'3.s Types of follow-up • information fco be collected 
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i^- e s tj^nna i r Conti nued 

E. UNDECIDED STUDENTS; 

4 

1. vNeed* of follow-up _ _ 



~2^ Frequency and /or length" of~f ime to belFbTloxvecr 



■up. 



3. Types of follow-up information to be collected 




4. Other Considerations? 



III. FRCM THE STANDPOINT of a student follow-up information SYSTEM^ 

what types o"f information (other than what is normally collected) 
should be collected oh students WHILE AT THE INSTITUTION: 



> 
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Questionnaire , Continued 



IV e What personne l (institutional and/or state leveT)\Should be" 
involved in the following stages of a student follbw-ufr ^ 
information system? 



1. Documentation of student's educatio 




2. Follow-up information retrieval and analysis_ 



3. Implementation of decisions derived from follow-up date 



1. In the actual collectionj of follow-up information, what 
methods and techniques dp you feel should be utilized by 
those collecting the information? * 



* 



2. Should these methods and techniques vary when dealing with 
, \ the. different categories of students (Occupational- technical 
Adult and Continuing Education, University Parallel, etc.)? 
If. so, please explain. 



/ 

/ 



Once the follow-up information is obtained, what methods or 
procedures should be implemented in order to assure appro- 
priate utilization of the resujts? 



Page 24 . 

Cue s t i onna Ir e ? Co^jjiiied 

VII. What methodology should be followed in the ANALYSIS AMD REPORT^ 
ING of follow-up information from the standpoint 'of: 

. " 1; Local institutional planning^ ^ 



2. State-wide planning^ 



3. Coordination between individual community co liege s^ 



VIII. What reliable procedures could be utilized for determining 

whether or not job skill requirements of employers, have been 
met? 



IX. In your opinion, what types of information isr needed from the" 
employer of a former student? 



W£ 30 
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Ques tion nair e , Continued 



X. Please express your opinion concerning the need for identifica- 
t&oii of a student's specific educational goal (selected courses 
♦ or degree for skill upgrading, personal enrichment > transfer, 
etc.)-- and the implications (if any) of this knowledge on 
effective follow-up of that student. 



XI. Please complete each of the following sentences with a concise, 
targeted statement consisting of approximately eight to ten 
words. A targeted statement may he defined as one which- 
identifies specific characteristics of a .student follow-up 
system from your vantage point. ,« 

An effectively designed follow-up system for the community 
college:, l 

1. Should emphasize: , 

I 2. "Shetfld de-emphasize: " m 

3. Should continue: 

4. Should eliminate: , m 

5. Should increase : d k 

6* Should; solve: ^ 

7. Should provide for: 

8. "Should develop': ^ m : 

9. Shou- 1 d improve: L , 

10. Should invent: 
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^P.st i<^nni r e , . Continued 



XII. 



In this, section please ' express any ideas or concerns which you 
feel are relevant to the design of an effective student follow- 
up system. Also, provide any additional questions to which 
you would like to have the panel's response. (ANY AND ALL- 
THOUGHTS ARE SOLICITED. WECENCOURAGE YOUR CREATIVE, ORIGINAL 
THINKING.) 



Thank you for your assistance. Please return 'in the enclosed 
envelope BY NOVEMBER 7. 



PF/R&D/TCJC 
10-2-3-74 



ERIC 
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For Project Use Only 
Id No,: 



Title Code No. 



Identification 



Name 



Title 



Emp loyer ■ 

_S_CQS -DELPHI - ROUND II 

~ / * 

Ins mictions 

You are asked to react to the attached statements concerning relevant definitions 
and desired characteristics of a student follow-up system. 

Please indicate your agreement -or disagreement with each statement in the follow- ' 1. ) 
ing manner. Circle as follows if you strongly agree with* the statement: 

© 2 3 4 5 6 7* 

On the other hand, if you strongly disagree with the statement, you should indicate 
by circling as follows: 

1 2 3 4 5 6 @ 

Circling number 4 would indicate that you* feelings of agreement and disagreement 
are about equal; while circling any. other number (2,3,5,6) would indicate respective 
levels of agreement. 

Should you have a comment or question concernin g a sp^M f io g ta t emen t , 
please feel free to utilize the space below each statement for this 
purpose ♦ 

Space is provided at the end of the questionnaire for any specific statements to 
which you would like the Panel's response. 



PF/RStD/TCJC 

o u - 27 : 74 ' ' -33 

ERIC 



9 

ERIC 



P,age 28 




SCOS-DELPHI - R( 


r. ' • 

)UND II 


o ' 

« a 


DEFINITIONS AND CHARACTERISTICS OrT'A, STUDENT FOLLOW-UP SYSTEM * 


2 • 


1. A follow-up system should obtain information about the student's 
educational goal at the, time of follow-up instead of when a 
student begins a course of study < * 


1 2 3 4 5 6 7 


2. Program graduates should be followed -up only once. 

>r - 


1*2 3 4 5 6 7 

/ 


^ A f* orr\ r\ 1 pHftY»" *c florin c>(\ »> c o C f"ll/l »*t> t" i 'ta <™\co iri t- i r^JI 1 o3i i Of* t" i M A 
J ♦ *» LUiiip 1CLL L JL. £> viti. JLH^U cir> d D LUULu L \. 1 tU.> C LviV.H.fi »H ilu 1 \J\J J K. X. w 

is completed culminating in a degree, certificate, selected 
courses, or portions of selected ^courses . 


y 

1 2 3 4 5 6^7 


V; . rr -— _ 

4, Rnndom sampling techniques would*#De an acceptable method of 

drawing* conclusions fro:?, follow-up information, which would be 
applied to the total population of, the group of students studied. 


1 2 3 4 5 6 7 


5* A c Omftrfi Hen's ive adul£ and continuing £>rfim;af*"inn fnl inu-nn cuK- 
,* system would not be a practical, component in a total college 
follow-up system. 


jj 

1 2 3 4 5 6 7 

* 


6. Program coordinators and instructors should have the responsi- 
bility of collecting follow-up data. 


1 2 3 4 5 6 7 


7« Summer students should be treated the same as long-semester 
students in a follow-up system. 


JL 2 3 4.5 6 7' 


8. Occupational-technical students should be followed-up the same 
length of time as academic students. 


1 2 3 4 5 6 7 


9* "Educational Goal" is defined as that objective which a student 
selects to work towards through a formal educational process. 


. 1 2 3 4 5' 6 7 


l 

10. Plans for institutional changes as a result of conclusions drawn 
from follow-up data should be reported to the. State. 


1234567/' 


11* Whe theT Or not A' Student hr>c jiM n'norl n "ma^I/of-iKlrt eL-ill' 1 *• 

the training institution should be determined by the college, 
based on that students academic performance/ 


1 2 3 4 5 6 7 


n v^tum ^duutiiej) snouia dc i.oiioweci-up annually for five years. 


1 2 3 4 5 6 7 


13. A "drop-in" is defined as a^ student who does not complete a 

formal program of study but does achieve his or her educational 
goal in one semester or less. 


1 2 3 4 5 6 7 



/ 



34 
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SCOS-DFLPHT - Wnu^n TT fVnMriM^ 


/ 

BEPINITIONS AND CHARACTERISTICS OF A STUDENT FOLLOW-UP SYSTEM 


o> 

V 

u 

U W 
tO t-l 

< Q 


14. Follow-up data should be collected by individuaL'lns titutions , 

analyzed by a centralized (statewide) processing agency, and 
"« reported back to the individual institutions. 


1 2 3 4 5 6 7 


L5. Occupational-technical advisory committees should be involved in 
the student follow-up process. 


1 2 3 4 5 6 7 * 


16. Both information received from the student and from his employer 
should be analyzed in determining whether job skill requirements 
have' been met. 


1 2 3 4 5 5 7 


17. A student follow-up 'system should provide for methods of recog- 
nizing the need for specific curriculum revisions. 


1 2 3 4 5 6 7 


18. The use of classroom questionnaires is an acceptable means of 
collecting student follow-up information." 


1 2 3 4 5 6 7 


19. The documentation of a student's, initial educational goal should 
be maintained and updated at the beginning of each enrollment 
^PArio^^^ " - 


1 2 3 4 5 6 7 


20. A student should have enrolled in at least on^ourse funded 
with occupational-technical funds before he or afce is counted 
as an occupat iona 1- technical program enrollee. 


o 

1 2 3 4'5'"6 7 


21. Information pertaining to the student's educational goal should 
hi obtained during the time of the' registration process. - 

* ' yJ ■ 


1 2 3 4 5 6 7 


^ZTTT A fallow-up system should provide for a plan to implement de- 
cisions derived from follow-up data. 

1 


1 N 2 3 4 5 6 7 

\ 


23. Each individual insti-tu-rfon should develop their own methods 
for local collection, analysis and reporting of follow-up in- 
formation based on uniform (statewide) procedural guidelines . 


\ 

lv2 \3 4 5 6 7 

\ . • . 


24. An immediate follow-up should be initiated on students who do 
not complete the period for which they enroll. 


123 4 5 6 7 


25. Identification of a student's "educa tiona 1 4 goa 1 * should provide 
~ — xhe bas is for -follow-up . _ 

\ - — — ~ 


1 2 3 4 5 6*'7 


26. Program graduates should be followed -up at the end of the firsts 
third, and .fifth year. 4 





9 

ERIC 
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SCOS-DELPHI - ROUND II, Continued 




* / 

DEFINITIONS AND CHARACTERISTICS OF A STUDENT FOLLOJHJP SYSTEM 

. » . . . . y 


Agree 
Disagree 


27. A follow-up system should emphasize Che cjafllection of data which 
will reflect needed institutional changed 


1 2 3 ^4 5 6 7 


28 . Telephone contacts with students sKould be used extensively by 
the follow-up system, / 


I ? 3 4 5 6 7 


29* More community college funding will be necessary for the purpose 
of implementing a comprehensive follow-up system, *l 


1 2 3 4 5 6 7 


30. It is not practical for a follow-up system to treat full-time 
students the same as students taking only one or two courses • 

< 


12 3 4 5 6 7- 


3i. One designated office within a local institution should be as- 
signed the responsibility of cpnducting student follow-up studies. 


12 3 4 5 6 7 


32. The "conditioning" of students to follow-up studies is important 
to a follow-up system* 


1 2 3 4 5 6 7 


33. The "exit interview" is an acceptable method of collecting 
follow-up information. 


1 2 3 '+ 5 6 7 


34. Each department within an institution should indicate the 
types of follow-up information which will be collected 
from its former students. \ / 


1 ? 3 4 5 6 7 


35. A. student follow-up system should emphasize the -collection of 
data which reflects the student's opinion of the local institu- 
tion. 


12 3 4 5 6 7 


36. A follow-up system should include methods for continual evalua- 
tion and updating of its own procedures. 


1 2 J3^5 6 7 


37. Local administrative endorsement and support is necessary for the 
successful implementation of a foliow-up system. 


\ 2 3 4 5 .6 7 


3Sv Foilow-up studies should be applied to all students who have 
attended the institution. 

' \ 


1 2 3 4 5 6 7 


39. The State should develop a plan to promulgate significant follow- 
up studies to interested institutions. 


1 2 3 4 5 6 7 


A randomly sampled number of program graduates should be 
foTl6wed-up~for^ a— period- o£ lon£e_r_ than^f ive 'years. 


l ? 3 4 5 6 7 



36; 
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SCOS -DELPHI - ROUND II. Continued 


DEFINITIONS AND CHARACTERISTICS OF A STUDENT FOLLOW-UP SYSTEM 


Agree 
Disagree 


%lm It is not practical to follow-up adult and continuing education 
students* in cultural/recreational and personal type classes. 


1 2 3 4 5 6 7 


^2.. Data collection Instruments used in the follow-up o'f occupation- 
al-technical students should be. the same as those used for 
university parallel^ students . 


1 2 3 4 5 6 7 


Student follow-up information should be reported to local in- 
stitutional Boards of Trustees for their utilization. 


1 2 3 4 5 6 7 


i4. Adult and continuing education follow-up should be given a lower 
priority than regular credit students in a follow-up system. 


1234567 


^5. The "undecided student" should not be followed-up until he or 
she decides upon an educational objective. 


1 2 3 4 5 6 7 

r^— " 


Ud. A "student* follow-up system should emphasize the collection' of 
data which will.be beneficial for statewide planning and co- 
ordination. 


1 2 3 4 5 6 7 


^7. Students enrolled in classes with a Continuing Education Unit 
(CEU) designation should be the only adult and continuing 
students to be followed-up. 


1 2 3 4 5 6 7 


^8. Students who complete semesters, regardless of their educational 
goal, should not be considered drop-outs, 
i 


1 2 3 4 5 6 7 


^9. The student's opinion of whether the college fulfilled his or 
her educational needs is one of the most important types of 
follow-up information to be obtained. 

* * 


1 2 3 4 5 6 7 


50. Information regarding a student's salary should be retrieved. 


12 3 4 5 6 7 


51. The student should be asked what changes, if any; additions, 
deletions, modifications, etc.; he feels would improve the 
educationaj. program he was previously pursuing. 


1 2 3 4 5 6 7 


52. Compensatory/developmental students should be followed-up only 
upon completion of enrollment in a course of study other than 
compensatory/developmental. 


1 2 3 4 5 6 7 


33. Program graduates should be followed-up longer than non- 
graduates . 

— : * 


1 2 3 4 5 6 7 . 
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5C0S-DKLPHI - ROUND II, Continued 


/ 

' DEFINITIONS AND CHARACTERISTICS OF A STURENT FOLLOW-UP SYSTEM 


s 

2 g 


54* An "undecided student" is defined as one who has made no firm 
commitment to a particular educational objective. 

/ 


12 3 4 5 6 7 


55 • An immediate follow-up should ^e^ initiated on students who 
complete a semester but do no-t enroll the following Ion* 
enrollment period. 


12 3 4 5 6 7 


56. A "stop-out" is defined as a student who "temporari ly terminates 
his formal educational pursuits with full intentions of con- 
tinuing at a later date.' 


1 ? 3 ^ 5 6 7 


57. The documentation of a student's educational goal should be , 
- the responsibility of counseling personnel. 


1 '2 3 k 5 6 7 


58. Program graduates should be followed-up annually for no 
longer than three years. 

/ ■ . * 


■ 

1. ? 3*4. 5 6 7 


,59. A "marketable skill" is defined as only that knowledge and/or 
skill acquired from a institution which will enable the stu- 
dent to acquire employment utilizing the skill. 


1 2 3 4 5 6 7'. 


60. An "occupational-technical program enrollee" is a student who 
designates an occupational-technical major. 


1 2 3 4 5 6 7 " 


61. A "drop-out" is any student*who leaves*college (formal with- 
drawal or walk-off) prior to Achieving his stated objective, 
v/ith no intention of returning. 


1 2 3 4 5 6 7-,, 



In the. space provided below please write any additional statements to which you would 
the panel's response. 



PLEASE RETURN WITHIN FIVE DAYS 



PF/R&D/TCJC 

12*2-74 - 
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For Project Use Only ~j 

Id No.,: 

Title Code No, / 



Identifl 



.catior/^ 



Name 



Title 



Employ er_ 



r~l Please check this box if you wish to re'ceive the final SCps-DELPHI report in 
' — ' its entirety. ; 

SCOS-DELPHI - ROUND III 



Instructions 

. . /' 

As was stated in the beginning of our SCOS-DELPHI (System Characteristic Opinion Study), 
the purpose of this Study is to establish a consensus of opinion among Texas public 
two-year educational institutions as to the desired characteristics of a student fo'llow-up 
information system. 

Along with the Round III form we are also enclosing each participant's respective 
Round II response.^ ^onrated onto the Round III form is statistical data compiled from 
all the Round II responses in terms of Median (M) and Quartile Interval (Qf^-C^) . The y 
Quartile Interval (Q1-Q3) contains the middle 50 percent of the total responses; its 
size gives you some indication of.liow widely the responses differed from one another^ 
In some instances of extremely shewed response distributions some rounding nay be 
evident. This condition is not on error bias, but rather a function of statistical- 
mechanics. The Median (M) reflects the midpoint of all responses to each statement. 

In keeping with the Delphi research method, Round III presents the • opportunity for 
reevaluation of your:, thinking . As you compare your Round IT response to ^phat of the 
panel as a whole/ i£ is requested that you revise your response on Round' III in keeping 
with the group opinion. If your Round III response remains outside the 7 Quartile Inter- 
val (i.e., lower than the designation or higher than the Q~ designation) we ask that 
you offer a written explanation in the space provided below that particular statement. 
If additional space is needed*, please use the back of the questionnaire pages. For % 
example, ifi^-3.1 and (53=5.1 and your Round III response is 3 or below or 6 or above, 
please explain your reasons for maintaining your opinion. THESE NARRATIVE EXPLANATIONS 
WILL PROVIDE VALUABLE INPUT FOR OUR FINAL ANALYSIS. (Feel free to comment even though 
your/response is within the Quartile Interval, should you so desire) »^ 



Additional statements have been added to this Round 111 fp.rm^ 
and provide any comment you/wish. 



The following method is 
1. 




>leasej:espond to these, 



revising your answers: 



Lay youx-Rouno! Il/resppjaa^on top of 
ee-Disagree s^aW§on both forms, 
allow you^to Tf£ew tne statistical d, 
to -yertfif"own Response on Round II. 




e Round III form so that you can see the 

aeh corresponding statement. This will 
we/have provided on Round III in relation 



2. 



3. 



Revise your' answers where you think appropriate by circlii^ th^Rpumrtll form 
in the same manner utilized on Round II. EV EN IF YOW^RE SPiDNSE^lAlNS THE SAME 
PLEASE MARK THE SAME RESPONSE ON THE ROUND tll-FOffiU^^ 



ave filledr-in 



Please check to make sure you haXre filjed^^in the identification section at the 
top of this page. Place your Roijnd'lfl response 7 , al^ngwith this page* in the 
enclosed envelope and return. 



(J^ank you. 
ERJC/R&p/TCJC 



T*31-75 
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SCOS-DELPHI - ROUND III 



DEFINITIONS Ap CKARACT£RISTICS OF A STUDENT ^FOLLOW- UP SYSTEM 



u 



O 
O 

u ■ 



1. A folloy-up system should obtain information about the student's 
educational goal at the time of follow-up instead of when a 
s tudent begins a course of study. 
* i 



,1 2 3 4 5 6 7 

" M - 5.0 



2. Program graduates should be followed -up only once, 



Q L - 4.9 Q3«6.9 
1 2 3 4 5 6 7 



"A "completer" is defined as a student whose educational objective 
*is completed culminating in a degrde, certificate, selected 
courses, or portions of selected courses. 



Random sampling techniques would be an accepLab Le^nethod of 
drawing conclusions from follow-up information, which would be 
applied to the total population of the group of students studied. 



Q L - 1.0 Q. 3 » 2.0 

1 2 3 4 5^6 7 

~ M « 1.2 



1.5 



Qo= 4.6 



1 2 3 4 5 6 7 
M - 3.0 



/ 



A comprehensive: adult and continuing education follow-up sub- 
system, would not be a practical component in a total college 
follow-up system. 



1 2.2 4 5 6 7 

■ M - 4.7 



6. Program coordinators and instructors should have the responsi- 
bility of collecting follow-up dafa. 



Q L » 3.1 Q 3 = 6.6 

1 2 3 4 5 6 7 

M - 5%2 



7. Summer students should be treated the same as long-semester 
.students in a follow-up system. / 



Qj* 1.4 



5.9 



r 2 "3 4 5 \ 7 

M ■ 3.5 - 



8. Occupational- technical students should be followed -up the same^ 
length .of time as academic students. 



1.0 Q 3 ' 



3.8 



1 2 3 4 5 6 7 

' <*M. 1.7 



9. "Educational Goal' 1 is defined as that objective which a student 
selects to work towards through a formal -educational process. t 



Q L « 1.0 Q 3 - 2.0 

'1 2 3 4 5 6 7 

■ M - 1,3 



10. Plans for institutional changes as a result of conclusions drawn 
from follow-up data should be reported to the State. 



Qj» 1.3 Q3 0 4i2 

1 2 3 4 5-6rf^ 




2.3" 



11. Whether or not a student has attained a "marketable skill 11 at/ 
the training institution should be d6termincd v by the college A 
based on that s tudent *s academic performance*, - . u ; 



If 3.7 Q3" 6.7 

1 2 3 4 5 6 7 

M - 5.3 



12. Fro^ram graduates should be followe^-up annually for five years, 



Qj- 2.1 Q3 a 6.3 

1J2 3 4 5 6 T 
M - 4.4 



13. A "drop^n" is defined as a student who^oes not complete a 

formal prhgram of study but (does achieve his or her educational 
goal-JLn onfc semester* or less* 



T 



Qj^- 1.8 Q3- 4.4 

1 2 3 4 5 6 7 

M - 3.4 



7 
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l".r:0S-J)FT PtlT - HOUND ill, CimtLntwi! 


"DEFINITIONS AND CHARACTERISTICS OF A STUDENT FOLLOW-UP SYSTEM 

* * » 


0 

s 

o \ CO 
u * W 

<; . q 


14. Follotf-up data should be collected by individual institutions, 
analyzed by a centralized (statewide) processing agency, and 
reported' back, to' the individual institutions. 

: ^ : : 


Q L - 1.9 Q 3 « 5.9 

.12 3 4 5 6 7 

M ■ 3.6 


15. Occupational-technical advisory committees should be involved in 
/ the student fo llow^up process . 


Q L « 1.3 Q 3 - 3.6 

1 2 3 4 5 6 7 

. M » 2.2 


Both Information received from the student and from his employer 
should be analyzed in determining whether job skill requirements 
* have^been met. 

- . - —V^ 


Q L » 1.0 Q 3 « 1.5 

. 1 2 3 4 5 6 7 * 

M = 1.2 


17. A student follow-up system should provide for methods of recog- 
nizing the need for specific curriculum revisions, 

} i 


Qi= 1.0 Qo" 1 7 

1 2 3 4 5 6 7 

M « 1.2 


18. TheVuse of classroom questionnaires is an acceptable means of 
collecting student ilpllow-up information. 


q l « 2.2 Q 3 » 5.5 

1 2 3 4 5 6 7 

M - 3.7 " 


19. The documentation of a student's initial educational goal should 
be maintained and updated at the beginning of each enrollment 
period. ' ^. * "*\ 

' • ' • 3 


Q L « 1.1 Q 3 « 2.1 

1 2 3 4 5 6^ 

M - 1.8 


ZO. A student should have enrolled in at least one course funded 
wi nonoccupational- technical funds before he or she is counted 
as an occujrational-technica 1 program enrollee. 


Ql tt 1.2 Q 3 « 4.4 
1 2 3 4 5 6-7 

M = 2.1 


21. Information pertaining to the student's educational goal should 
be obtained during the time of the registration process. 

v ■ \ 


Q," 1.2 ' Q 0 a 4.0 

1 2 3 4 5 6 7* 

M - 2.1 t 


12. A follow-up system should provide for a plan to implement de- \ 
. cisions 'derived from follow-up data. 

' l 


1.0 Q 3 « 2.1 

\ 1 2 3 4 5 6 7 

\ M ■ 1.3 


23/ Each individual institution shoul^ develop tfieir own methods 
for local collection, analysis and\ reporting o'f fbl low-up in- 
formation based on uniform (statewlde)s procedural guidelines. 

a. - - ■ - ■ - — ■ ■ 


q l V i.a q 3 - 3.7 . 
1^34567 

2.0' 


24. An immediate follow-up should b^c initiated on students who do 
not complete the period f or whicnSthey enroll. 

♦ 


Q r l.o\ Q 3 ° 2.5 

1 2 3 4\ 6 7 

M - 1.5 


?5>>sJdetitification of a student's "educational goal" should provide 
- thssbasis for follow-up. 


Q - 1.6 Q 3 « 3.6 

1 2 3 4 5 6 7 

M - 2.4 


2«fr^N!fcrogram gractontes shouj^be followed-up at the end of the first, 
ttvh?4, and fifcK year. 

£% ■ . ■ ■ ■ i. ■ ■ ■ ■■■■■■ ■ ■■ 


Q L * 1.4 Q 3 - 4.2 

1 2 3 4 5 6 7 
2.4 



V 



c 




%<:os 


-DELPHI - llfiljtm III, Continued 






DEFINITIONS AND CHARACTERISTICS OF A STUDENT FOLLOW-UP SYSTEM 

S 


Agree 
Disagree 




27. 


A follow-up system should emphasise the collection of data which x 
will reflect needed institutionafShanges . • x 


Q l a l#0 Q 3" 3#0 
1 2 3 4 5 6 7 
M - 1.6 




;.8.,. 


Telephone contacts with ' students should be used extensively by 
the foNLlow-up system. ■ 

■ \ - , . 


Q r 2 -° Q 3~ 4 * 2 
1 2 3 4 5 6 7 
M - •3 £ 2_____ 












29. 


More ccmi\;un\ty colLetfe funding will ^e. necessary for the purpose 
of implementing a comprehensive follow-up system. 

f, • \ 


Q L = 1.0 Q 3 ^ 2.7 

1 2 3 4 5 6\7 

'• M^1.5 \ 




30. 


It is not* practical for a follow-up systejn to treat full-time 
students the same as\students taking only one ox two courses. 

\ 


Q,- 1.7 Q,° 5.6 

1 2 3 4 5 6 7 

M - 3.5 


\ 


31. 

\ 


One designated office within a local institution should be as- 
signed U\e responsibility of conducting student follow-up studies. 


Ql» 1.0 Q 3 ° 2.3 

,X,2 :3 4 5 6* J, 




32. 


The 'Conditioning" of students to follow-up studies is important 
to a follow-up system. V . 


1 2 3>4 5 6- 7 

M, « 1.4 




33. 


The "exit interview" is an acceptable method of collecting 
follow-up information. 


Ql" 1.4' Q 3 J 4.2 

12 3 4 5 6/7 

M «.2.7 




34. 


Each^l^pa!r^aent wittritn^n institution should indicate the 

types of f o now>»£^jjnf o^SWon^hich will beocollected , / 

from its former s tudefrbfi^T^^ y 


1 2 3 4 '5 : 6 7 

H « 2.7 


* 


35. 


A student follow-up system shoulB^emJ^size tRe^-c^l^ection of 
data which reflects the Student's opinKh of the locarHnstitu- 
'tion. 


Ql" ^ Q3- 3.3 

1 2-3 4 5 6 7 

" M » 2.1 




J6. 


A follow-up system should include, methods for continual evalua- 
tion and updating of its own procedures. 

* * . 


1.0 Q3- 1.8 

12 3 4 5 6 7 

M - 1.2 


- 


37. 


Local administrative endorsement and support is necessary for the 
successful implementation of afollpw-up system. 


Q r 1,0 Q 3 w 1,4 

1 2 3 4 5 6 7 

M - 1.1 




38. 


Follow-up studie$* should be applied to all students who have 
attended the institution. 


Q L - 1.2 Q 3 ° 4.4 

1 2 L4 5 6 7 

M" 2.3 




39. Tia^Sfcntg should develop a* plan to promulgate significant follow- 
up studies to interested institutions. 

? 


Q- 1.2 Q 3 « 3.S 

1 2 3 4 5 6 7 

, M « 2.0 ' 




W. 


A randomly sampled number 6f program graduates should be 
followed-up for a period of longer than five years* 

■ n — — 


Q L - 1.6 Q 3 - 5.4 

12/34567 
M - 3.1 
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^OS-DELPHI - ROUND 1X3., Continued 



fkl. It is not pra 
students in cu 




DEFINITIONS AND CHARACTERISTICS OF A STUDENT J'OLLOW -UP SYSTEM 




to foLlpw-up a,dult and continuing education 
l/recreatio*na^and personal type classes. 

\ 



42. Data collection instruments used in the follow-up of occupation- 
al-technical students sfrould be the same as those used -for 
university parallel student 



43. Student follow-up information should he reported to local in- 
stitutional Boards of Trustees for their utilization. 



M 

to 

< 



0 

<u 
u 
to 

w 



Q'l" 1.5 Q 3 « 5.9 

1 2 3 4 5 6 7 

.M ■ 3.7 . 



Qi- 2.9 Q 3 - 6.4 

X 2 3 4 5 6,7 

M -4.8 



Q L ~ 1.1 Q 3 » 3.0 

1 2 3 4 5 6 7 

M » 1.7 , 



V4. Adult and continuing education follow-up should be g^ven a lower 
priority than regular credit students in a follow-up system. 



*5.~ The "undecided student" should not be followed-up until he or 
she decides upon an educational objective. 



46. A student follow-up system should emphasize the collection of 
data which will be beneficial for statewide planning and co- 
ordination. 




Q L « 1.3 Q 3 » 3.8 

1 2 3 4 5 6 7 

M * 2.3 



J. Students enrolled in classes with a Continuing Education Unit 
designation should be tfre' only adult and continuing 
st udent3~7fco^be_ f o 1 lowe d - up ♦ 



48. Students who complete semesters / regardless of their 
goal, should nbt be' considered drop-outs^ 




Q^.3.8 Q 3 » 6.5 

1 2 3 4 5 6 7 
M « 5.4 ■ 



49. The student's opinion of. whether the college fulfilled his or 
her educational needs is one of the most important types of 
follow-up information to be obtained. 



30. Information regarding a student 's~ salary should be retrieved. 



V 



\ 



Q L " 1*3 Q 3 « 4.5 

1 4 5 6 7 
M » 2.9^ 



Q L « 1.2 Q 3 « 2.8 

1 2 3 4 5.6 7 

K « 1.9 



Q « 1.5 Q.« 3.9 



31. The student should be asked What changes, if any; additions, 
deletions, modifications, etc. Ke % feels would improve the 
educational program he was previously pursuing. 



52. Compensatory/developmental students should be foilowed-up only 
upon completion of enrollment in a course of study other than 
compensa tory /deve lopmenta 1 . 



53 ♦ Program graduates should be followed -up longer than non- 
graduates. 



Qj» 1.0^ Q 3 » 1.9 
1 2 3 4 5 6 7 

M - 1.3 




j^jMrTS . Q 3 - 5.7 

1 2 3 4 5 6 7 
M - 3.7 
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;COS-DKTPHI - KOUND Hi f Continued * X u 


^\ 

DEFINITIONS AND CHARACTERISTICS OF A STUDENt'f^LWW-UP SYSTEM* 


Agree 
Disagree 


54. An "undecided student" is defined as one who has made no firm 
commitment to a particular educational objective. * 


Q - 1.0 Q,- 2.0 

I 2 3 4 j 6 7 

M = 1.3 


55. An immediate follow-up should be initiated on students who 
complete a semester; but do not .enroll the following lonj» 
enrollment periods 


^s*L- 1.9 


56. A "stop -out" is defined as a student who temporarily terminates 
his formal educational pursuits with full intentions of con- 
tinuing at a later date. 


Qi" J..0 Q,» 2.4 
l2 J- 4 ll? 7 


57. The documentation of a student's educational goal should be 
the responsibility of counseling personaj»l^" 


uQl- l - 3 %' 4.3 
T"2 3 A 5 6 7 

M f 2.6 


~^58. . Program graduates should be followed-up annually for no 
longer than three years . 


3.6 Q 3 - 6.4 

1 2 3 4 5 6 7 
M - 5.1 


59. A "marketable skill" is defined as only that knowledge and/ or 
skill acquired from a institution which will enable the stu- 
dent to acquire employment utilizing the skill. 


Si J H.J 

1 2 3 4 5 6 7 

M - 2.5 


60. An "occupational- technical program enrol lee" is a student who 
^ , designates an occupational- technical major. 


Qt- 1.1 Q~« 3.*. 

12 ,? J> 2 %6 7 


61. IT^drop-out" is any student who leaves College (formal with- 
drawal or walk-ofX)^rriorU:^) achieving his stated objective, 
•with ho intention of returninjT^^^ / 


Q," 1.0 Qo- 2.6 

1 2 3 4 5 6 7 

M - 1.5 


62. Before a survey of employers of former students is made 

regarding "an evaluation of the training an employe has re- 
. , ceived",^ the institution should first be responsible for"' 

obtaining the permission of these former students to make such 
a contact.' 


1 2 3 4 5 & 7 


63. Standardized, statewide fol-low-up questionnaires should be 
designed for local institutional use. 


1 2 3 4 5 6 7 


64, Students who withdraw from college prior to completion of the 
semester should be followed -up regarding their reasons for 
college withdrawal. 


1 2 3 4 5 6 7 



\ 



Any additional comments?. 



• 


I ■ 


1 — — f — I v - ' 





PLEASE RETURN ttlTHltt FIVE DAYS 



Page 39 



APPENDIX B 



S -DELPHI Institution, Employer or 
:ee Representation 



Table 2. SCOS -DELPHI Employment Area Represen- 
tation 



Table 3. Area of Employment Analysis 



Table 4. Graphic illustration of Convergence 
between Round II and Round III * ' 
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Table 1. 

SCOS-DELPHI Institution, Employer or Committee Representation 

rp 

Institution; Employer or Committee Number of Panelists 

Project FOLLOW-UP Advisory Committee 12* 

Advisory Council for Technical- 
Vocational Education in Texas 5 

Alvin Junior College 8 

v Amarillo College ^ 9 ) 

, Angelina Colleg^Il 1 

Austin Community College ^ 4 

Bee County College 1 

,Blinn College 1 

Brazosporjt College 1 

Centr^f Texas College 1 

Clarendon College 1 

Cisco Junior College 1 

College of the Mainland 7 

Cooke County College 4 

Dallas County Community College District 8 

Del Mar College m 3 ^ 

El Paso Community College 4 

Frank Phillips College 1 

Galveston College 4 

Grayson County College 2 

Henderson County Junior College 4 

Hill Junior College " 1 

Houston Community College 3 

Howard College at Big Spring 2 

Kilgore College - 5' 

Laredo Junior College 1 

Lee College t 4 

McLennan Community College * 8 

Midland College 2 

Navarro College 1 

, North Harris County College 1 

Odessa College 5 

Panola Junior College * 2 

* Paris Junior* College % 1 

Ranger Junior College 5 

San Antonio College 8 

San Jacinto College 4 

South Plains College 1 

Southwest Texas Junior College 2 

^Actually 16. Four also serve in tfye capacity of Liaison 
Representative and are included in the count with their 
rn 9^ respective institution. •«>./: 
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Table 1. Continued 

Institution, Employer or Committee 

Tarrant County Junior College 

Temple Junior College 

Texarkana Community College 

Texas Southmost College 

Texas State Technical Institute 

Tyler Junior College 

Vernon ^ftegional Junior College 

Victoria College 

Weatherford College 

Western Texas College 

Wharton County Junior College 

Texas Education Agency 

Coordinating Board 

Other 

Total - 



Number of Panelists 

14 
6 
2 
1 
1 
1 

1 c 
0 
11 
5 
2 
7 
2 
2 



193 



9 

ERIC 



/ 



47 
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Table 2.- 

SCOS -DELPHI Employment Area Representation 

Number of Percentage of 

Area of Employment Panelists Total Panel 



1. 


Support (Data Processing) 


3 




1.67. 


2. 


Support (Learning Resources) 


2 


• 


1.0\ 


3. 


Texas Voc/Tech Advisory Council. 


5 




.2.6% 


4\ 


State Agencies 


13 




6.7% 


<; 

j • 




1L 




7 ^7 


6. 


Administration (Staff) 


8 




4.2% 


7. 


Administration (Voc-Tech) 


18 




9.3% 


Q* 
O • 




1 7 




ft 8*/ 
O • 0/ 0 


Q 


voc-iecrx r acuity 


1 Q 




o op/ 


10. 


Student Services and Development 
ill ^» ^% « l 

lUeaHSJ 

v » 


21 




■ 10.8% 


1 1 


otuaenu services ana ueveiopmenc 
(Counselors) 






1ft 17 


12. 


Student Services and Development 
(Placement) 


5 


t 


2.6% 


13. 


Adult and Continuing Education 






6.7% 


14. 


Su^ort Services (Admissions and 
Records ]' 


11 




5.7%' 


15. 


Research 


9 




4.7% 




Totals 


193 




.100.0% 



7" 
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ERIC 



50 



Page 45 




ERIC 



51 



0 
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9 

ERIC 





ERJC . 53 




K: 



f 



ERIC, v 



r 





«3 
« 
V 

u 
< 



g 




ERIC 



59 
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erIc 





63 



Page 58 




9 

ERIC 



64 




' : : • ' 

1 Key: 

* , Round II 

Round III 



Table 4 
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4 



. .Agree 

Statement 



13 



> Disagree 

1 Z 3-45 - 6 7 

2468 246 8 246 8 2 4 .6 8 2 468 2468 

" ■ J \ 



14 



15 



16 



17 



18 



19 




4 © 

ERIC 



67 



> v 



V 

\ . — 




Table 4 
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1 ■> 



Statement 



* Disagree 
6 7 




v 



J 



Table 4 
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•4 



Jtatement # 



62 



63 



64 



0 

ERJC 



.Agree v ' Disagree 

I 2 3 4 5 h * 6 1 ' . 7 

"2468 2468 2468^ 246 8 2 4,6 8 '2 4 6 8 



} 



I 



I 



J 



q • 



>' 



74 



/ 



/ 



. / 



Note : 

Statements 62, 63 
and 64 were added 
to Round III and 
rated only once. 
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EXPLANATION OF ANALYSIS 
(SCOS-DELPHI Round III) 



A. ranking scale qf 1 through 7 (indicating agree - disagree 
respective ly) W as used on the Delphi Roilnd II and Round III 
instruments. ; \ 

The following. SCOS-DELPHI analysis of- the Round III total panel 
response to each statement has been computed as follows: 



Mean 

Median ' • 
SD 

I/Q Range 



QA-1 through QA-7 
•N/R 

0/R 4 



Totals 



The average, panel response. * 

The midpoint^ of all responses. 

Standard Deviation. 

The Interquartile Range contains the 
middle 50 percent of the total responses, 
In some instances of extremely skewed re 
sponse distributions some rounding may 
be evident. V This condition is not an 
error bias, >\4t rather a function of 
statistical Mechanics. 

Indicates the number of panelists re^ 
sponding ^ith &a£h respeptive rank of 1 
through 7. 4 

No response. - 

A res.pons'e other than 1 through 7, orC$ 
response indicating* more than one choice 
for a particular statement. ■ • 

The total number of responses to e^ch 
statement. 



76 



t i 



J 



ft "'i 
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PROJECT FOLLOW UP 



$£P&„JteJ3$I RpUND_III TOTAL : PANEL RESPONSE 



r 1. 



SCOS-DELPHI ROUND III QUESTION 



A follow-up system should obtain information about the student's 
educational goal at the time of follow-up instead' of when-.a 
student begins aj course of study. 



MEAN 



MEOI AN 



4.77*87 4.95000 



2. Program graduates should be followed-up only once. 



5.76963 5. 89500 



A "completer" is defined as a student whose educational objectivt 1.47644 
is completed culminating in a degree, certificate, selected 
courses, or portions of selected courses-. 



1.26400 



Random sampling techniques would.be an* acceptable method of 
drawing conclusions from follow-up information^ which would be 
applied to the total population of the group of students studied. 



3.18229 2.96000 



A comprehensive adult and continuing education follow-up sub- 
system would not be, a practical component in a total college 
follow-up system. 



4.41799 4.58064 



6« Program coordinators and instructors should have the responsi- 
bility of collecting follov:-up dara. 



4.86979 5.05882 



7 # , Summer students should be treated the same as long-semester 
\ students in a follow-up system. 



3.56250 3.56452 



0. Occupational- technical students should be followed-up the same 
length- of time as academic students. 



2.12042 i. 7327,6 



9 "Educational Goal" is defined as that objective which a student 
^ selects to work towards through a formal educational process. 



10/ Plans for institutional changes as a result of conclusions drawn 
from foll|ow-up'data should be reported to the State. 



1.43979 1.24609 



2.79058 2 



.41^75 



11, Whether or not a student has attained a "marketable skill 11 at 
thg training institution should be determined by the college, 
q based on that students academic performance, 

ERIC • ■ • ?7 



L 



15183 5.31111 



so 



I/O RANGE QA*'i. QA«2 QA = 3 QA«4 QA»5 QA*6 QA«7 N/R flm TOTALS 

1 / I" 



1.62976 3^57432 6.1127* : U 1 33 37 30 51 \y / \, 1 191 



/ 



0.97579 5.30357 6.37250 2 I I lo 42 #0 



0.94798/ 0.68200 1.82018 125 57 4 I 




I 1 191 



1 3 I 1 191 



1.46952 2.09016 3.92857 IZ 61, 50 4? 3 3 14 0 1 192 



1.70585 3.09146 5 



.QQZ b/ , 14 



1.43568 3.92000 6.01563 




/4l 28 31 49 17 3 1 ' -1 



89 



5 15 50 34 64 w 17 yh 0 192 



1.61898 2.13265 4.8800JK/ 17 49 28 31 50 8 9 0 1/ 192 



1.46196 1.08232 2 .60484 8 2 58 il 4 4 6 6 2 / 0 191 



0.88341 0.87305 1.77232 128 c 56 2 1 1,1 2 1 1 191 



1.32163 1.83025 3.70109 21 81 32 46 / 2 3 6 1 1 191 

. . '■ / / 

1.38541 4.24432 6.20089 - 6 _ 3 6 / 44 45 56 31 1 1 191 

/ 

O . 




SCOS-DELPHI ROUND III QUESTION 



MEAN HEOIAM 



12/ Program graduates should be followed-up annually for five years. 4.42408 4.4558g 



X3 # A "drop-in" is defined as a student who dMs not complete a 

forma l pr ogram of study but does achieve ftTs ot her educational 
goal in one semester or less. ^ 



3.12766 3U14286 



14. Follow-up data should be collected by individual institutions, 
analyzed by a centralized (statewide) processing agency,, and 
reported back to the individual institutions . 



15 Occupational-technical advisory 
15# the student follow-up process. 



ctees should be. involved in 



3.70157 3.63750 



2.54167 2.25247 



16. 



17. 



Both information received from the student and from h-s employer 
should be analyzed in determining whether job skill requirements 
have been met. — 

A student follow-up system Should provide for methods of recog- 
nizing the need for* specific curriculum revisions. 



1.24468 i.09494 / 



1.20526 1.09006 



18. 



The use of ciassroom questionnaires is an acceptable' means of 
collecting student* follow-up information. 



3.83069 3.58333 



19. 



Th£ documentation of a student's initial educational goal should 
be maintained hnd updated at t^ie beginning of each enrollment 
period. , 



1.98413 1.93310 



. 20. 
. 21. 



A student should have enrolled in at least one course funded 
with occupational-technical funds before he or she is courted 
as an occupational- technical program enrollee. . 

Information pertaining to the student's educational goal should 
be obtained during the time of the registration process < 



2.74345 * 2.31034 



2.58947 2.19307 



22. 

ERLC 



.A follow-up system should provide for a plan to implement de- 
cisions derivejd from -follow-up data. 0 r 

* ) 

•'-</" 79 



l.*84*fr - 1, 32051 
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SD 



/ / 

I/O RANGE 



OA -I QA=2 QA«3 QA=4 Q^*5 0A*6 QA*7 >N/R /0/R TOTALS 



/ 



1.57973 3.16848 5.83182 10 7 46 7 34 28 55 II 1 1 191 



1.14608 2.16667 3.96377 7 60 4l 69 



4 1 188 



1 .66578 2.23113 4. 86806 9 53 28 40 36 7 IB 1 1 1*1 



1 .27815 1.77723 2.96000 20 101 50 8 3 1 9 U~ 0 192 



C. 77441 0.79747 1.39240 158 24 - 3 0 1 ,0 2 v 3 2 1 88 



0.61982 0.79503^ 1.38509 161 24 , 3 



0 0 12 1 190 



1 .44856 2.84701 4.75000 « «9 15 67 42 35 6 15 3 1 169 



0.78664 1.60035 2.26584 33 142 5 



/ 



1 



2 1 1 3 1 189 



l.«239 # 1.76149 3.65625 25 87 25 40 ' 2 4 * B 1 1 191 



1 .38408 1.72277 p. 16000 25 101 



25 24 4 3 B 



2 1 190 



0.84765 0.91026. 1.88571 *117 70 0*1 2 0 2 0 1 192 



ERLC 

hnnmiimpmaaa 
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SCOS-DELPHI ROUND III QUESTION 



MEAN MEDIAN 



23 # Each individual institution should develop their own methods 
for local collection, analysis and reporting,, of follow-up in- 
formation based on uniform (statewide) procedural guidelines. 

f 

24# An immediate follow-up should be initiated oh students who do 
riot complete the period for which, they enroll. 



2.37895 2; 16355 



1.58730 1.46428 



25. Identification of a student's "educational goal" should provide 



the basis for follow-up. 



2*39791 2.26500 



/ 



26 ; Program graduates should be followed-up ax the end of the first 
£ m third fifth year. 9 



2.90000 2.44118 



27* A follow-up system should emphasize the collection of data which 
will reflect needed institutional changes. 



1.84896 i. 57-018 



/ .Telephone contact^ with students should be used extensively by 
the follow-up system. 



3.09424 3.01695 



2<^ More community college funding will be necessary for the purpose 

of implementing, a comprehensive follow-up system. ^ U68ZZ9 



1.42308 



30 # It is not practical for a follow-up system to treat fi>Ll-time * > 

students the same as students taking only one or two courses. 3.*4Z7l 



3.31818 



One designated office within a local institution should be as- , a 0 ?ic 

• signed the responsibility of conducting student follow-up studies, 4 ^*<" 



l.316?4 



The "conditioning" of students to follow-up studies is important 
3Z# to a follow-up system. 



1.46316 1.34071 



33. The " exit interviewlt is an acceptable method of collecting 
follow-up information. 



2.8 1771 2.50000 
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SO 



I/Q RANGE 



OA=l Q*=2 04=3 QA=4 OA =5 QA*6* 0A=7 , N/R , 0/RTQTA!^ 
i. 10195 U71963 , 2.77381 '24 107 42 6 ^ . 5 3 3 2 I 190 , 



) 



0.80937 C.98214, 2.03354 98 82 3 3 r-2 0,1 3 1 189 

I - \ . 



0.93719 1.78750. 2.90417 19 1 00 60 7 / \1 2 ? # 2 0 19 i 



1.38241 U88235 3.78750 .15 85 31 40 . 8 4-7 1*2 190;, 



J? 



192 



1 191 



1.07679 ^.02174 ' 2.41228 92 57 34 . 2 4 \ 2 1 * 0 

1. 14933, 2 .20259 3 .8 5000 ,7 58 , 59 55 6 \ 1 1 

1.04985 ^yd.96154 1 2 .10606 104/ ^,66 12 6 0 .3 0 

'-/ - ■ • " • • '' /■■ ■ 

1.54479 .2.09615 4.80612 17- 52 33 27 49 1,0 . 4 0 1 192 



0.80489 0.90812 U. 9038 5 117 65 1 5 i / 0 1 t I "191 

7 \ . 

0.69298 0.92035 1 .9.1549/ 113 71 4 1 '.-0 0 1 2^ 1 1^0 




1 



1.33584 1.84247 3.6500X3 "23 73 42 ' 40 2 8 4 D / 1 .192 
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SCOS-DELPHI- ROUND III QUESTION 



MEAN • MEOIAN 



34. Each department within an institution should indicate the 
types of follow-up information which will be collected • 
from its former students. 



2*92147 -2.66667 



A student follow-up system should emphasize the collection of 
S|ata Vhich reflects the .students opinion of the local institu- 



368 2.1.666 7 



36. A foaicw-up s^em should include methods for con tinua Leva lua- 
tion and updatmg^of its own procedures'. 



1.15104. 1.08537 



* 37. Local administrative endorsernfent and support is necessary for 'the 
successful implementation of a follow-up system. v , 



♦i.09896" 1.03039 



- 38. Follow-up s^dies should be applied to. ill- students. who have * 
attended the institution. * 7' 



2J76963 2.32692 



39 ' ^ e .l^L S !l 0U } d . deVel0{ ? a P lant0 Promulgate significant follow- 2^2135^ 2.1M09 



uf> studie's to interested institutions. 



40. A randomly sampled number of program graduates ^should be 
followed-up for a period of longer fhan jEive years. 



* .3*29843 . 3.^31* 



4l- It is not practical. to follow-up adult, and continuing education 
students ith^tural /recreational and personal type classes, 

42. Data collection instruments used in the rolloTfup of occupation- 
al-technical students should be'the same as those used' for * * 
university parallel students. • * t 

/ \ ' l - - / ' 

43£* ♦Student follow-up infonration should be reported to loral in- 
stitutional Boards of Trustees for their utilization. * 



'3.6U58 - 3.46667 
t 

4^58947 * 4.72591 
2.22105- 2.04286 



J 



44. v AduU and continuing education follow-up Should be given a lower 
priority than regular* c^fcdit st£0ent£ in a 'follow-up"«ysteW . 
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QA = I 


QA=s 


2 0A*3 


0A^4 
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0/R 










1.34558 
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_ SCOS-DELPHI ROUND III QUESTION 



MEAN . MEDIAN* 



45. The "undecided student" should not be followed-up until hfe or 
she decides upon an educational objective, V 



/ 

5*06316 5*50000 . *- 



46. A 5tudenc follow-up system should emphasize the collection of 
data which will be beneficial for statewide planning and co- 
ordination. 



2.64398 2.40341 



47.* Students enrolled in classes with a Continuing Education Unit 
(CEU) designation should be the only adult and continuing/* 
* students to be followed-up. l\ 

• . , • ^ f 

4 8# Students Who complete semesters, regardless of the\r educational 
t goal* should not be considered drop-outs • 



5*01587 5.07813 



3*03704 2*68056 



49. 



The. student's opinion of whether the college fulfilled his or 
her educational needs is one of the most "important types of 
follow-up information to be obtained* ^ 



-1.95811 1.92806 



50. Information regarding a student's salary should be retrieved 



• ' \ . 

5X, The student should be asked what changes, if any; additions* 
deletions, modifications, etc; he feels would improve the* 
educational program he was previously pursuing. 

i 

5 2# Compensatory/developmental students should be followed-up only 
upon completion of enrollment in a course of study other than 
compensa tory /deve lopraen ta 1 * 



2.65445 2. 43125 



1.19792 1. 10000 



4.84210 4.83333 




53, „ p rogram graduates should be followed-up longer than non- 
graduatesT, 



3.58730 3. 54545 : 



54. % An "undecided student" i$ defined as one who has made'no firm 
commitment to a particular educational objective. ^ 



1.49 215 1.31624 A 

1* 



•\ * ey An immediate N foi low-up should be initiated on students who 
v • complete a Semester but do not enroll the following, long 
enrollment per tod. * 
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"SO \ 1/CTPTN6E 



>l .40907 4.22619 6.09375 .9 ,4 



0A=i 0A=2 QA=3 0A=4 QA*5 QA=6 3A = 7 N/* 0/R TOTALS 
4 42 36 80 15 



.2 I 190 



I .17520 P.860BO 3. 14344 16 ' 88 61 12 



6-4 V D 2 191 



1.165 99 4 .05078 6.00373 1 1 



9 64 32 67 14 : 3 I 



189 



1.47777 1. 92606 3.90341 17 71 36 



44 3 10 8 3 1 189 



0.71508 1.58453' 2.27158 36 139 8 5 



2 1 0 0 4 i 9l 



1.26407 1.83437' 3.15000 80 65 ' H 3 5 6 2 0 y M f.~. 



0.48131 0.8C0G0 1.40000 160 2? 1 0 

1.34412 , 3.88525 5.96610' 4 4 ' 16 61 30 



0 0 



0 

V 



l 192 



59 1$ '2 l l90 



1.59995 2.rS35l ' 4. 85000" '10 . 




26 33 45 7 11 2 2 * 



,0. 82417 0. 90812 , 1,897^3-^17 66 2 2 3 



189 



°* I I I 191 



7 



0.90005 1.58519 * 2.28889 36 135 9 4 



£3 1 2 
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SCOS-DELPHI ROUND III QUESTION 



MEAN 



M F0MN 



55 # . A "stop-out' 1 is defined as a student who temporarily terminates 
his formal educational pursuits with full intentions of con- 
tinuing at a later date. » 



1^65263 1.47938 



57. The documentation of a student's educational goal should be 
the responsibility of counseling personnel. 



2.90052 2,43210 



58. Program graduates should be fpllowed-up annually for no 
longer than three years. * 



4,92632 5*12857 



59, A "marketable skill" is defined as only that knowledge and/cr 
skill acquired from a institution which will enable the stu- 
dent to acquire- employment utilizing the skill. 



2*92632 2*47561 



60. An "occupational-technical program enrollee" is a student who 
designates an occupational-technical major. 



2.^3^55 2.l6495^f 



61. A "drop-out' is any student who leaves college (formal with- 
drawal or walk-of f)%prjLor to achieving his stated objective, 
with no intention Vf returning. , 



i. 63158 1,45000 



62. 



63. 



Before a survey of employers of former students is made re- 
garding "an evaluation of the training an employe has receiv- 
ed, 1 the institution should first be responsible for obtaining 
the permission of .these former students to make such a contact, 

Standardized, statewide follow-up questionnaires should 
designed for local institutional use. 



3.08021 2.44231 



2.94681 2.34783 



64. 



Students who withdraw; from college pripr to completion of the 
•rfemerarter shouia be followed-up Vegarding their reasons for 
college withdrawal. 



1.80952 1.44500 
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so 



I/O R ANG£ 



CA*i QA=2 QA=3 QA=4 QA*5 0A»6 *34«7^ S/l Q/* TOTALS 



0.97082 0.989*9 2-06875 97 80 5 4 I ^ 0 3 2 I 190 



i. 44915 1.84259 3. 81410 20 81 30 39 7 7 . 7 I I 191 



i. 38596' 4..00961 6.02273 5 8 8 52 35 66 16 I 2 190 



i.40107 1.89634 3.79762 * 15 82 33 42 7 2 -9 2 l\ 19.0 



3 6 4 L " i 191 



1.25521 i. 67268 2.89103 ,31 97 39 ii 



0.96848 0.97500 > 2*04487 100 78 5 2 i 2 <2 0 3 ' 190 



2.08867- U 17754 4.95833 69 26 18 19 



18 



13 b 0 .187 



,1.92888 1.35454 4.31250 55 *46f 27 -16 
1.15732' 0.97250 2.25909 100 55 17 . ' 8 



18 10 16 5. 0 . V88 



^88 



6 1 2 ' L . '4 



0 1 189 
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REPORT OF MINORITY. RESPONSES 



Representative Reaspns_for Deviation fr^m 1 



Total Panel 
Group Consensus lQ Range 

1_ — Qi ....... 



1. A follow-up system should obtain information aboutr the 2r4 v £.7 
student's educational 'goal • at the time of follow- up 
instead of when a student begins a course of study. 

* ' r 

Above range : 

"ShouTd be both, but definitely when study begins. 11 * 

M In formation on a student from the time he begins 
his course of study seems essential in order to 
.ascertain to what extent, if any, that infotmation * 
' , relates to his behavior at the time of follow iro." 

* \ * 

"It is crucial to measurfr educatixfrial goaTs at iga- 
** tial contact, as well as continually throughout the 
student 1 s matriculation period and at follow-up , 
because a good school or program can *be expected tjo 
produce change in them, and the change must be mea- 
sUrgd ." ; * . 

Below range: ? 
"I doty*t feel it is responsibility o*£' follow-up to 
know what' the goal was at* first of course.'' 



2. Program graduates should be fcfllowed-^up only once;. * 

\ Above range! • 

"A*single follow-up would bias the data against those 
. who are livable to obtain immediate. .employment in . xt 



4.9 6.9 



Below range; ^ 
"Once is simply not enough." 



"To me, .ttye primary purppse of the follow-Hip should. , 
be to find out about undertrldning and overtraining 
based upon job requirements .J One evaluation (6 mos. 
aft£r graduation) would do this," 



A ."completer"* is defined a^ a^student whose efludk- 1.0 
ti$>nal objective is* completed culjninatiag in a degree, k 
certif icat^, setected ^oi^rses , or^portions of selected 
courses. \ 0 - , m 



2.0 



Page 

... ^ Q 

Above range : 

"(^elected courses., pr-poTtions of selected courses) 
. _ ^es.e items are/not elements. _of_a _^£ecific .academic. .. 
~-6ir^scis(Spstionai rfaining 'program. " " ^ " 

"Disagree wftti statement 'portions of selected courses' 

Random sampling techniques would be an acceptable- % . 1 
methocr o£ drawing, conclusions from follow-up informa-' 
tion/ whicVwo^ld be applied to the total population < 
of/the group of .students studied. 

/ ^ • ^ V' 

/Above range: ' * * 

"True random sampling would f^uire more .effort than 
total population study since we are concerned with 
^-x^latively small population also for graduates of 
a single institution it would likely not be accurate*. 11 

/ <• • 

n Th^s will not meet le'gal requirements. 11 

"Too m^chr. variance in programs and people. M 



Below range : I . * 
"If sample is large enough, very acxepta>£eCj' 

"Stratified randoms sampling the onjfy way to curtail' 
expense that would be incurr&d-hy total population 
♦ studies, M " , * . - 

A comprehensive adult- apd *cdntiniiing education follow- 2 
up v subsystem would not "be a practical, component in 
total college follow-up /system. / 

Above range* * ^ % ^ ' ' 

"(Comprehensive adult/ ^nd continuing education) These, 
'ar^ indeed aspects, of the philosophy of the community 
college, ^4nd should be treated* equally . 11 

"Adults make up* a* large percentage of students ii> all 
programs and should be .fdilowed' up* 11 ' . * ^ 

* . t • % m \ v » , * 

• "Continuing education is P no # l,ess important than any 

• other function in a community/ qo liege- -even\ * though 
•resources are not appropriately distributed \" • * 



, • Page 86 

/ • Qi 03 

Below range: 

"We ^ave 10,000 ^such students. Thi3 is' impractical : ~1 » / 

lobbies change. Adults don't care to be. followed J'- „. 

ftiey don't even like reHNtape~ of registration! 1 
Plain stupid to fpllow-UpiN Sounds like another ~* 
bureaucratic empire gilding. 11 

"A physical impossibility for large systems of adult J* ' 
education. n \ " c r \ ' o ; 

ir The^ numbers would be too great and many take courses ' * 
. just for leisure or personal reasons not for employ- ' 
ment demands; 11 



/it 



Would be too costly; 



Program coordinators and instructors should have the 3.1 6.6 
responsibility of cpllecping follow-]up data. - / - . 



Above s range:" ' 
1, Lack of consistency makes ttfiis Concept totally 
unacpep table. " 



"Aside from the obvious possibility of bias or self-' 

interest, the collecting of valid and*. reliable follow- 
— up~data is too, big a^job to be 0 added to their respons- 



nihilities." 



Below range? ' » , # * / 

, "Ii\s true tors axeman rather unique pbsitioij to know * 
more about, student £oals, immediate /plans , changes, 



etc:" 



"They have a close, contact* with students therefore . v 
should be able; to g^t a greater percent response." : 

"I feel; the instructor is th6 key-to follow-up-- 
^h^jrmust bV involved with responsibility." / . , 

; y . * / . . 

Summer - students should be treated the jsame ds ^ongr 
semester students' irt a follow-up system. / * 

Above range- :• . ,i 

"The same principle as adult 'Studqnt, many are one 
time only fenro^Lees and these should not.be con-, 
sidered part of a 'program' ." , 



1.4 5.9 



"In our school-many- of our summer s^ool students 
are drop- ins only for summer.',' 



' —Be l o w r a itger " ~ ~" ' 

"If you are going to follow a 'student' then follow 
them all- -(in full time -programs) ." ' 

~7~ * ' ' . ' > 

8. . Occupational-technfcal students should be f olfowed-up 
m the same length of time as academic students; V 

• Above ranee: * -J'S * 0 5 

* "Occupational-Technical should be followed up longer 
than academic students." '• ' 

"0-T students should be followed up longer to help 
-£he oc^-program make changes to keep current and 
: remaj#>yalid.''. 

"StiU feel the complexity of the 'work world' th? 
o/t student enters directly^ after, educational ex- 
per zence^ demands that he be followed up longer 
— •- - period of time'."' . • 



3. "Educational Goal."] is Refined as that objective which 1 
a student selects tro^work towards through a formal 
educational process,. ■* • 

' Above .range: ' ». 

"Or* does -not always have to achieve educational goals 
through a formal process because this* process in some 
c 6 3££ s -, should .make ^one a self learner." 

BeloW-rartge: , 

■ .-.'.'The^process -does' noty have to be formal— especially 
in occupational ppcgram ? " ' 

E>. .•Plans for Institutional . changes as a result of con- 1 
elusions drawn from follow-up data should be reported 
-' fc,0 the State. r * 

' - . • ' • . ^ ; 

Above range; « » . - 

. . "I don't feel- they should be informed and it will 'be 

rifore reports to file." . ^ .-" 

.. . * ' •» . ... ^ 

"Locals .control should be mainlined. „vWhy should the 4 
State need . -the information? 
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"My question is simply, what will the State do with 
this data once they get it, other than dissemination?" 



"This is to meet legal • requirements . " . ^ 



Below range : 

,-■« So long as state funded state should have da'ta. " 

"I believe this essential c f or accountabilit 

.1. Whether or not a student has attained a "marketable 3.7 "6.7 
skill" at the training institution should be determined 
by the college , based on that student's academic per- 
formance. 4 \ * 

$ - i 1 

Above ran^ e : * > 

fl It must be determined by the 'market 1 . 11 

^ '/The college probably has inadequate information and" * * 

is ^biased." § c : , /• 

The buyer of the StkjLH must determine marketability 
not^the 'developer ." / 

"Should be bas^d on whether -the skili 1 sells 1 . 1 

1 --i ' 

Below range : 0 " ' . 

"The school can develop 'the skill but the student „ 
may nQt have the desire to use it." ' ° . 

. ' - * • j 

2. Program graduates should* be followed-up annually for 2.1 6.3 
five years. ' * ' 

Above rang£ : 

"In my opinion., the primary purpose of. the ft)llow-up „ *^ 
should be to improve the training program. Any " - 

follow-up beyond the *f irst wobld be too cOstly con- ' • 

sidering the vdlue of the results to be obtained." • 

"Waste of money." 

"Too extensive and expen's ive- to ' handle . " 

Below range: „ ■ *i. \ 

"Biggest weakness of follow-up is short range predic- * / • 

tion is alltha£ y we have." 
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• 13*. A "drop-in" is defined, as a student who, cloes not com- 
plete a formal program of . study but do^s achieve his 
^ ° r her educational v g oal in one semester or lessj^ J 

Above range: \ • 

"A drop- in doesn't Necessarily have to achieve any 
goal. A drop-m is a drop-in. 11 

Below range: ' 0 

"Makes sense. 11 " * > 

» \ 

jm . i4 # Follow-up data should be collected by individual in- 1.9 
stitutions, analyzed by a centralized (sthtewide) 
processing agency, and reported. back to the individual A 
institutions. \ . 

Above range : 

"Let the institution analyze the data and report its c 
. findings and proppsed changes to the state." * 

^Institutions should have a choice if they Waht to 
\ , collect that particular information and 'if they 

want to provide that information," 7 . - . 4 

f * * "Data should be processed by each institution/for 

each school's use. Each school's -needs are too 
r < fe different in Texas; therefore, I think, each school 

.should be *<;omplet:ely responsible . for its own follow-?- 
' up procedures and results." m . • 

"This should be the local responsibility. It. is 
* - difficult -for me to understand how the State could 

do- this . " * 
*" * * * 
f Beto,w range : * 

*'< ' * "Apptears to be most 'economical. 11 
/ * / 

15. Occupatiopal-technjLcariL advisory/committees should be '1.3 
involved in the student folloy-up process . 

4 Above range: ; °* / * . ^ / m ^ 

VMembership of these committees are not sufficiently 
. 0 o versed'" in research techniques tq be objective.^.. they 

. tend to °he political. ir * ' •> ^ \ J« 

"This is not the. function of advisory committees. 1 

ERIC I " , 95 • , - : "V;? 
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■ - Si 

M I can see no involvement on their parts; only to 
extent information collected. Can be used in 
making future recommendations . "~ 



Below range : . 
"Such committees can off er. insight as to type of 
data to be collected. Setter definition of \marketable 
skills; sample -of employer input. 11, 0 

^ "Even though this may be difficult they should have 
some role in the process." u 

16. - Both information received from the student _and from L0 

his employer shduld be analyzed iri determining^whe^her 
job skill requirements have been met. 

Above range : t \ 

"The student's "satisfaction with his skills is our 
only concern. Did we give the student what he* 
wanted and needed." 

17. A student follow-up system should provide for methods 1,0 
of recognizing the need for specific curriculum re- 
visions. 

i 

ftbove range : 

"That's real good — but isn't tha't really expecting too 
much from a rather general-purpose survey/ 1 , ; ; 

18. The use of classroom questionnaires is ah acceptable . 2.2 
means of collecting student follow-up 'information, * 



v Above range : 

\ "Classroom time should not be utilized in this manner. 
^ Possibly make it a part of the registration process." 

"FolloW-up relates, mpj&e po a student that has left." 




"He's gone~~trhe 1 Follow-Up f is no longer in the class- 
room." 

/ 

' BeloxjT range: 

c "We use this method and keep' it updated until his 
^ last contact with the school. It works very Well 

and provides information for a/jrequired number of 

reports. 11 



19. 



20. 



> - 
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The documentation X* \ # n 

^■P^range^, \ \ ' \ 

3Uy h3Sn,t Ranged his go ais °^ probacy <• 

D ^a should be /elate>^to aJ V ' ^ 

\/ goals andxgoa]* 

A student shW^, • ^° als / fla nge." 

funded with enrolled m at- i X 

enroll. "^^"PaUonai-.e^f °^o, ' 

''^^ent.shoj^ ^ X / . 

o«^na P [°f T ^%L 0r e n n ?? CU P--nal- 

Several of our nuX>>d ' \ 

before ever f- a i,,- /T^ st ude nts tak^ •« \ 

H pw can a stj^dent bp\ \ \ 

. 8°al should ln « to the scihL nt .\. , \ 

<^«on proce S e s° btained ^dMjS^.' Ss^jj,, ^ 



Q3 
2.7 



4.4 



proci 

• ^2y^_rangej_ x x 

"Most students ar* •■ • - " > i 

it we re talking V,,,, . 
Bu t registration L^L decla ^ng major 

sense of the^^ £ ^ '^/se'tfng?^ 



/ 



,4.0 ^ 



V 





Below range: 

"Students are unavailable before registration, and 
after registration, changes will De costly to the 
student in time and money* 11 

22. A follow-up system should provide for a plan to im- 
plement decisions derived from follow-up data. 

Above range: 

"If it is a s&ate follow-up this might intrude on 
local prerogative- -too much possibility of state 
control. 1 !^ 

/ 

"This £s a separate function to be developed^by 
individual schools . " 

Each individual institution should de^lop their own 
!^thods"--for local collection, analysis and reporting 
^ \ofxol low-up. information based op/uniform (statewide) 
procedural guidelines. 

Above range : 
"Only i^f guidelines ^j^usable and fit," 

"A state wide system provi^as more data uniformity." 




1.0 



1.2 



"I guess I ddn't have as much\ftaith as most'in the 
usefulness of state- level guid&Hnes . I agree that 
certainr^kinds of follow-up shouftKbe local--for local 
use--but strictly local data collation would make 
program* comparison and state-level decision -making 
very difficult." 



Below range: 
"If it is a state 
local prerogative-- 
control. " 



.low-up this might intrude on 
much possibility of state 



24, 



.1 



An immediate follow-up shouldN>e initial 
who do not completes the periods 



on students 1.0 
they enroll. 



2,5 



Above range: 
"This could work a 
require a full- tijme"pers 



nothing but check 



on di 



.arge 
its, etc. 



ool. It would 
schools to do 



ERLC 




25. Identification. of a student's "educational goal" 
should provide the basis for follow-upT. V; 
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Qi 

1.5 



03 
3.6 



/ 



Above range: 

"What impact the educational experience has on the 
s students educational and employment upward mobility 
should be basis not- changing goals. 11 . . 

Below range: 

"It should at least provide the basis tor analysis 
of follow-up data. It makes no sense at all for 
example to count as 'program attrition 1 those ?who 

0 never intended to complete the program. 11 / 

26. Program graduates should.be followed-up at the end 1.4 4.2 
of the first, thirci, , and ^ fifth year. 

Above range: 

"After one follow-up the student looses interest in 
• the school and will not /return papers. 11 

"Too costly for the value of the results to be ob- 
tained." ' 

"Period, too long. 11 ^ ' - 

27. A follow-up system should emphasize the collection of 1.0 3.0 
data which will reflect needed institutional changes. 

Above range: 
"Can students really evaluate needed changes?" 

"Whether or not we are needirfg follow-up reflecting 
institutional changes, we need to emphasize, just 
as , strongly, follow-up to see where, and how, our 
students are doing- 11 



28. Telephone contacts with students should be used ex- 
tensively by the follow-up system. 

Above range: 

"Believe these would be a complete waste of time." 

"Impractical-~subjective. How many can be reached 
\ by phone?" 



2.0 4.2 



n 
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Below range: 

"When possible, this would seem to be a more current 
source of intormation than a written response. 11 

More community college funding will be necessary for 1,0 



Above range: -X 
"I think it could be implemented within the counsel- 
ing framework now funded. 11 

"Should, have been doing this in the first place. 11 

"Follow-up is guaranteed by community college in 
application for funds. Funds should be reduced or 
withdrawn from community colleges which do not do 
it." 

It is not practical for a follow-up system to treat 1.7 
full-time students the same as students taking only 
one or two courses. 

Above range: 
"They should all be treated equally. 11 

"The student's goals are the same, so why let mechan- 
ical problems dictate different follow-up processes'?" 

» 

"Latter possibly are taking courses out of interest 
rather than need, or may not be willing to commit 
themselves to a program." 

One designated office within a local institution 1.0 
should be assigned the responsibility of conducting 
student follow-up studies . 

Above range: ' 
"One person may be assigned the responsibility of 
compiling and reporting but teachers and coordina- 
tors should assist in collecting." | 

The "conditioning" of students to follow-up studies 1.0 
is important to a follow-up system. I 
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Above range: v 
"Depends on design, ana who is 'to be contacted— 
~ surveyed. 11 

33. The "exit Interview", is an acceptable method of .1,4 4,2 

collecting follow-up information. 

Above range: 

!, No--if student has not finished he may be mad about 
teacher or grades." 

"Pertinent follow-up information can only be obtained 
after an individual exits the institution." 

' Below range: 

"Particularly so for dropouts, stop-outs, non- 
completers and others who may never be heard from 
again." -X 

"Where possihife-- this also giyes insight into 
reasons i&f leaving." N 



"It is yxhe very most important tool in follow-up." 




Eapn department .within an. -ins ti tut ion should ' indicate L.4 4.4 
ifie types of follow-upxinf ormation which will be 
collected from its fi5rmer students. 



Above range: - 
"Department determination of data prejudices infor- 
mation in favor of the department rather thaYi being 
objective arid satisfying institutional and state- 
wide* needs , 11 

"Probably desirable but hardly operate- -probably would 
require a supplemental survey. V 

"(should indicate the types of follow-up information) 
It may never get off the ground if everybody has a 
major part. 11 

"Should this be allowed, you will never get a follow- 
up system. " 

I ) 

Below range: ^ 
f, How else can it utilize the information?" 
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"Makes good sense. 



35. A student follow-up system should emphasize the 
collection of data which reflects the studentrs^ 
.of the local institution. 



36. 



/ 



Above range >v / 
"This should Ere includes but other areas are at 
least as important so /it should not be emphasized 
over anything else!" 



"I disagree with 



3elow ranse; 



"Student V?/th inking 
though^ve may not 

''His /n^nion is the 
be 



wording emphasize opinions . 



• Student 'opinion's/ 1 should be included, but shctuld 
be secondary c^iiderations to more 1 objective \ 
measurable fa< 
amount of re/rainihs, etc. 



-i.e. employment stat ist icsl 



may be most important even 
Like it." ~ 



most important data that can 




Elected. No one else can give you that." 



A follow-up system should include methods for 
continual evaluation j and updating of its own pro< 
idures . 



No responses received outside interauart lie range. 



sent atvd s 



£dcai administrative jehdorsement af*d support. is 
jriecessary % f or the successful implementation of a, 
Low^rup system. 



No established trend 



among the minority responses. 



33. Fy611ow-up studies should be applied to all students 
ho have attended the ^institution. 

I - 

Above range; , 
"No--hobby courses, general/service cQurses--non- 
credit courses should not/be followed up." 

"Almost impossible inja /ery comprehensive institu* 
tion." 

/"Too costly and a wasije of effort for ad hoc program 
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JBelow range: 

n On what basis would you exclude someone or groi/p?!" 



M They should all be treated Equally. 11 



A 



y. The. State should develop a plan to promulgate signif - 1,2 
icant follow-up studiesf to interested institutions. 

Below range: / 
n This would definitely be of value. 11 

"Definitely! Employment trends and opportunities 
encompass areas much larger than those served by 
individual institutions/ 1 

"The information must get back to the institutions. 11 

0. A randomly sampled number of program graduates should 1.6 
be followed -up for a period of longer than five years. 



Above 



"It 
not 



ic< 



range : 



seems to me that the value of the results would 
justify the cos p. 11 



"Over that period of -time results would be insignif- 



nt.' 




Below range: 

' "This would be a state- leWl~a.c£ivity Wd would be 
extremely interesting research jiha^djould be use- 
ful for long-rapge planning." 

i. It is not practical to follow-ut/ adult and continuing 1.5 
education students in cultural/recreational and 
personal, type classes. 



Above range: 
ft Why treat these people Any ^different 



? We/* 



^ou Id 



follow-up the effects/of all our educational ser- 
vices."! 

"Difficult to do, but very important in our school." 

"This kind of follow-up~T^tteeded--even ifTit^i^ ttot^ 
part of a statewide plan." 



10 
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U 

Below range: " - 

"Why should we? StiLl see no reason. Unless we • 
limit follow-up to students reaction to class and 
teacher--thac I will endorse," 

Data collection instruments used in the follow-up of 2.9 b.4 
occupational- technical student^ should- be the same 
as those used for university/parallel students. 

Above range: 

"Entirely different information is needed in some 
ii / 

areas. * 



"No! Ge€-Tech data will be of an entirely different 

nature from univ-parallel students and will be ob- 
tained from* different sources," 

"I would want to know how well 1 academic ! % students z 
had been prepared for further schooling. I would 
"be interested in the fit between training trtd job, 
requirements and in the specific utility of course 
content and instructional method to the job. Those 
two concerns seem pretty different to me. This 
•seems an^absurdity to me.— - * 

range : 



e nature of the data is the same." 



"/k well designed instrument could have sections for 
both kinds of students (and those two categories 
are not always mutually exclusive)." 

Student follow-up information should be reported to 1.1 ~~3.0 
local institutional Boards of Trustees for their r 
utilization. \-. 0 ^ 

Above range: v.\ 
"No—report to president or supervisor- -they mighty 
inform Board." ^ \ % 



Be low range: 

"They are responsible and have a right to know^r" 

j *** 
"T|hey need this information." 
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44. Adult and/ continuing education/ follow-up Should be 1*5 S.9 
<given a loiter priority thaV regular crecjit students 

in a follow-dp system. 

Above range: / • \ \ ^ / 

"These peopfe are important to the school 2nd 
community." ^ y 

"By no means. At an institution with 2 to 3 times 
* as many of them as regular credit students (such 
as ours), resources are consumed by . them; they 
come here for a reason; and measuring their 
satisfaction is important." 

* 

Below range: - K 
"At least in the initial follow-up." 

45. The "undecided student" should not pe followed-up 3.3 6.7 
until he or she decides upon an educational objective. 

Above range : ' t 
"'Undecided' characterizes that student and is^no 
less important than 'decided 1 .he may not decide 
for 5 more years... that doesn't make him any less 
important." 

"The undecided student comprises the majority of 
our students. Evaluation of counseling could be 
enhanced by a follow-up of these students." 

A 

S Below range: i * 

"Serves no purpose unless there is^at , least tentative 
objectives ." ♦ . 4 * «, * 

"How can a follow-up be meaningful if the student 
L followed -up has never decided upon an educational 
objective? Follow-up could be complete ly>. inaccurate 

46. A student follov-up system should emphasise the 
^collection of data which will be beneficial for 

statewide planning and coordination. — p 




Above range: 
"I think first emphasis should be fof : 
of. the local college." ' \ ' 



the benefit/ 



ER?a 
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"Program changes and updating must be dealt with 
on a local basis/ 1 

"I think the systei^shojuJLd ^emphasize da ta which 
will be us eful/lfe^he local institution—but it 
should also be beneficial for state-level use. 11 

Below range: 

IM We need one system for all schools and al<f stu- 
dents 1 ." ^ 

Students enrolled in classes withX^ontinuing 3. r 8 
Education Unit (CEU) designation^should be the only 
adult and continuing students^co be followed -up. 

V 

/ 

Above range: y / 

"This is arbitrary, not/a legitimate distinguishing 

mark," 
Below ranger 

"Students enrolling for 7 pieasure or leisure time 
don't relate to ^rogr^ms." 

Students who complete semesters, regardless of their 1.3 
[educational: goal, should not be considered drop-outs. 

ibove range: 

"Suppose his goal requires two years of study and 
completes only one semester?" 



"I woulc^ define drop-out as 
his educational goal." 



one who does not meet 



"The student may quitt because his goals are riot met 

especially the first year drop-out because you 
" don f t meet their needs." 

"Anyone who doesn't domplete their stated goal should 
^be considered, a drop-out." 

Below rang/: 

"If a student at leasjt completes a semester, they 
shouldf be considered on a different basis than one 
who does not complete/ coursewbrk." 



10G 



/ 



\ 
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49. The/ student 's opinion or whether the college ful- 1.2 Z.8 
filled his or her educational needs is one oV the 

most important types of follow-up information to ) 
be obtained. \ 

Above range: 

"Not an emphasis --need information on performance,- 
preparation- not subjective feeling influenced by 

irrelevancies # n * 

\ 

Below range: y > 
lr The student is the one in, the end who will have 
' to decide if the proaram was good or not/ 1 t 

50. Information regatding a evident ! s salary should be 1.5 3.9 
retrieved. ^ 

Above range: * \ 

,f I don't feel this is a valuable Criterion for \ 

determining the success of* a student or of the ' \ 
institutions programs. 11 \ 

"Onder new laws, you may be invading a students \ 
'right of privacy 1 . 11 c ^ 

' ' ~ 7 " * " * * / x * 

"Salary amounts are irrelevant to goal achievements." 

/ ; 
"This is their own private business.. Lf asked it 
should* certainly be' in a salary range' form." 

Below range: , * 

"In a material-minded world this is important. 11 * 



* it 



Students must know What kinds of salaries they can 
expect from their chosen careers." 



% "Important --if it can be gathered without violating 

right to privacy." * «fe 

51. The student should be asked what; changes, if. any; > i'^O* 1.9 
additions, delections, modifications, *etb.; he feels - 
would improve the educational, program he was previ- 



ously pursuing. 



\ 



Above range: * 
"I think it is important t<? have the students u views ." 
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Compensatory/developmental students should be 
followed-up only upon/ completion of enrollment" of 
study other than cpiSpens^tory/developme^ttal. 

Above range: 



"Compensatory/developmental programs tousjfe^be eval- 
uated by follow-ups in order to determine the/ 
effectiveness of C/D programs." * 7 

n • ^ f 

This implies that success in a compensator^ pro- 
gram is not important. 11 ( j 

Below range: ' ^ \^ 

developmental studies support subject Weas . "How* 
will student evaluate outside performance in college 
leve 1 cours e . 11 * V * v 

#». ' 

Program graduates should be- followed -up longer than 
non-graduates .' 



Above range: * 
"Graduation is not the only significant level of 
educational accomplishment or influence we shou 
- be concerned with. 11 \ [ 

"We believe* that if tfe are fulfilling our mission 
as a comprehensive community college, then any 
•exposure to our system should result in positive 
changes in students. This question again refers 
, to the 'educational. goals 1 issue; ^there are no 
.second class students here and if a student achieves 
his/her goal, which need not* be 1 program ^graduat ion 1 
we insist that is a successful student outcome; and ' 
if he/she does not reach that goal, then even 
'program graduation- 1 is either an unsuccessful 
outcome ^or a change of educational goal a" ' 

An "undecided scudent" is defined as ope who has made 
no firm commitment to a particular educational ob- 
jective. 7 ' \ % << m . ^ # * 

\ * • . - /* < Is 

.No established trend, among the minority responses 

/ 1 > m . y 

Aft immediate follow-up ,shouJLd*tyg initiated on 'student^ 
who complete a semester but do not en^oll^the foHqw 
ing long enrol Imepf' period. ^ r' \ ft 




■K 



\UNlVtR§FTY OF CALIF. 

LOS ANGELES 

\ 

PEB2 7l9t6 x 

EARINGHOUSE- FOR 
&TNIOR' COLLEGER 




\ 



Page J.OA 
Qi 



"Again, expense and difficulty, of keepmg.up with 
population makes longer period. impractical." 

*\ • 

'TheiV records should be kept permanently but the' 
folloV-up is difficult after 3 years." 

\ » ' 

59. A JWrkettable skill" is defined as only that know- 

x iedge anS/br skill acquired from an institution whid^ 
i will enable\the student to acquire 'employment utiliz- 
ing tjie skil]^ 



Above^agtjge. 
" f Mark> 



1.3 \4.3 



\ 



I 1 shouLd be defined as any talent, 
kn ow led ge>-QT skill which the student brings to 
the job, especTi^Ily \ if academic students are to be 
included in the follow-up system. 11 \ 



"It could well be the • student 1 s attitude gather 
than a 1 skill 1 that getd the jobv" 



"Marketab 
defined/as only thai 



.too broad of a texrni to be 



. to acquire . . . , Seems it 
should^ be 'acquire and hold a job 1 . Do not think 
it can be called market&bl£~ skill until the eia 
ployeVj>roves himself Oii'\the job 1 . 1 

60. Aft n decupa Clonal- technic t ; I pi^qgr am enroLlee" is a 
student who\ designates occupational-technical 
^^maior. ' 

Above range: 

!, May be pursuing coursewi^k without^ having desig 
nated major. An option aiay be: 1) designated-ma^or 
or 2) completion of a specified number of courses 
in an dec -tech program. M x v 




H No, it is a person who enrolls Hn such a course. 1 



B elow range: 
"Logical." 



9 
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61. A M, drop-out !l is.\any student who leaves college (for 
mal withdrawal dr walk-off) prior to achieving 1 his 
stated objective, with no intention of returning. 

No established trend among' the minority responses 



1.0 ?.6 



*1 



